Sep 25 16:55:18 devstack cinder-volume[75957]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 16:55:18 devstack cinder-volume[75957]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 16:55:18 devstack cinder-volume[75957]: we strongly recommend against using it for new projects.
Sep 25 16:55:18 devstack cinder-volume[75957]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 16:55:18 devstack cinder-volume[75957]: framework.  For more detail see
Sep 25 16:55:18 devstack cinder-volume[75957]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 16:55:18 devstack cinder-volume[75957]:   import eventlet  # noqa
Sep 25 16:55:20 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 16:55:20 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 16:55:20 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 16:55:21 devstack cinder-volume[75957]: INFO dbcounter [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Registered counter for database cinder
Sep 25 16:55:21 devstack cinder-volume[75957]: DEBUG oslo_db.sqlalchemy.engines [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG dbcounter [-] [75957] Writer thread running {{(pid=75957) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.rpc [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.rpc [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG oslo_db.sqlalchemy.engines [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.volume.manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Determined volume DB was empty at startup.
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG cinder.volume.manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75957) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.volume.manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 16:55:22 devstack cinder-volume[75957]: WARNING stevedore.named [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 16:55:22 devstack cinder-volume[75957]: WARNING castellan.key_manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 16:55:22 devstack cinder-volume[75957]: WARNING cinder.keymgr.conf_key_mgr [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG cinder.volume.drivers.lvm [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75957) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG oslo_concurrency.processutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75957) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG oslo_concurrency.processutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] CMD "cinder-rtstool verify" returned: 0 in 0.461s {{(pid=75957) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:22 devstack cinder-volume[75957]: DEBUG oslo_db.sqlalchemy.engines [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.rpc [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 25 16:55:22 devstack cinder-volume[75957]: INFO cinder.rpc [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 25 16:55:22 devstack cinder-volume[75957]: WARNING stevedore.named [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 16:55:22 devstack cinder-volume[75957]: WARNING castellan.key_manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 16:55:23 devstack cinder-volume[75957]: INFO cinder.volume.manager [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_db.sqlalchemy.engines [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:55:23 devstack cinder-volume[75957]: INFO oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Starting 1 workers
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Started child 76121 {{(pid=75957) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Full set of CONF: {{(pid=75957) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] ******************************************************************************** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Configuration options gathered from: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] ================================================================================ {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] allow_availability_zone_fallback = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] allow_compression_on_image_upload = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] allowed_direct_url_schemes     = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] api_rate_limit                 = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] auth_strategy                  = keystone {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] az_cache_duration              = 3600 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_availability_zone      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_host                   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_name                   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_stats_polling_interval = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backup_api_class               = cinder.backup.api.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backup_name_template           = backup-%s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backup_use_same_host           = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backup_use_temp_snapshot       = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] chap_password                  = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] chap_username                  =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_internal_tenant_project_id = 6ca37efaf4f940f6a34d394ce7b0fc91 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_internal_tenant_user_id = b4f0d62bf36147868e296a54c08f13d6 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cloned_volume_same_az          = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cluster                        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] compression_format             = gzip {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] compute_api_class              = cinder.compute.nova.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] config_dir                     = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] config_source                  = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] control_exchange               = openstack {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] debug                          = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] default_availability_zone      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] default_group_type             = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] default_volume_type            = lvmdriver-1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] disk_geometry                  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_client_cert             = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_client_cert_key         = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_data_namespace          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_ssl_cert_path           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_ssl_cert_verify         = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] driver_use_ssl                 = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] enable_force_upload            = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] enable_new_services            = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] enable_unsupported_driver      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] enforce_multipath_for_image_xfer = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] filter_function                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_api_insecure            = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_api_servers             = ['http://192.168.122.76/image'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_api_ssl_compression     = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_ca_certificates_file    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_catalog_info            = image:glance:publicURL {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_certfile                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_keyfile                 = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_num_retries             = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance_request_timeout         = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] goodness_function              = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] graceful_shutdown_timeout      = 5 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] group_api_class                = cinder.group.api.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] host                           = devstack {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_compress_on_upload       = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_conversion_address_space_limit = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_conversion_cpu_limit     = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_conversion_disable       = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_introspection_address_space_limit = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_introspection_cpu_limit  = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_upload_use_cinder_backend = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_upload_use_internal_tenant = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_volume_cache_enabled     = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_volume_cache_max_count   = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] image_volume_cache_max_size_gb = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] init_host_max_objects_retrieval = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iscsi_target_flags             =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iscsi_write_cache              = on {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iser_helper                    = tgtadm {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iser_ip_address                = 192.168.122.76 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iser_port                      = 3260 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_color                      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_config_append              = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_dir                        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_file                       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_options                    = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_rotate_interval            = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_rotate_interval_type       = days {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] log_rotation_type              = none {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] max_age                        = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] max_logfile_count              = 30 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] max_logfile_size_mb            = 200 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] max_over_subscription_ratio    = 20.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] message_reap_interval          = 86400 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] message_ttl                    = 2592000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] migration_create_volume_timeout_secs = 300 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] monkey_patch                   = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] monkey_patch_modules           = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] my_ip                          = 192.168.122.76 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] no_snapshot_gb_quota           = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] num_iser_scan_tries            = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] num_shell_tries                = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] num_volume_device_scan_tries   = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] nvmeof_conn_info_version       = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] nvmet_ns_id                    = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] nvmet_port_id                  = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_max_limit                = 1000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_ext_list          = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_listen_port       = 8776 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_use_ssl           = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] osapi_volume_workers           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] per_volume_size_limit          = -1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] periodic_fuzzy_delay           = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] periodic_interval              = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] public_endpoint                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] publish_errors                 = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_backup_gigabytes         = 1000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_backups                  = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_gigabytes                = 1000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_groups                   = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_snapshots                = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] quota_volumes                  = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] rate_limit_burst               = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] rate_limit_except_level        = CRITICAL {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] rate_limit_interval            = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] reinit_driver_count            = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] replication_device             = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] report_discard_supported       = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] report_interval                = 120 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] reservation_clean_interval     = 86400 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] reservation_expire             = 86400 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] reserved_image_namespaces      = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] reserved_percentage            = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] rpc_response_timeout           = 120 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] run_external_periodic_tasks    = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] scst_target_driver             = iscsi {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] scst_target_iqn_name           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_down_time              = 720 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] shell_completion               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] snapshot_name_template         = snapshot-%s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] snapshot_same_host             = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] split_loggers                  = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] state_path                     = /opt/stack/data/cinder {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] storage_availability_zone      = nova {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] storage_protocol               = iSCSI {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] syslog_log_facility            = LOG_USER {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_helper                  = lioadm {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_ip_address              = 192.168.122.76 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_port                    = 3260 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_protocol                = iscsi {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] target_secondary_ip_addresses  = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] trace_flags                    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] transport_url                  = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] until_refresh                  = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_chap_auth                  = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_default_quota_class        = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_journal                    = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_json                       = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_multipath_for_image_xfer   = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_stderr                     = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] use_syslog                     = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] verify_glance_signatures       = enabled {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_api_class               = cinder.volume.api.API {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_backend_name            = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_clear                   = zero {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_clear_ionice            = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_clear_size              = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_copy_bps_limit          = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_dd_blocksize            = 1M {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_name_template           = volume-%s {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_service_inithost_offload = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volume_usage_audit_period      = month {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] zoning_mode                    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_concurrency.disable_process_locking = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.auth_section = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.auth_type   = password {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.auth_version = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.cache       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.certfile    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.include_service_catalog = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.insecure    = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.interface   = public {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.keyfile     = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_password = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcache_username = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.region_name = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.service_type = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.backend                  = dogpile.cache.null {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.backend_argument         = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.backend_expiration_time  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.config_prefix            = cache.oslo {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.debug_cache_backend      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.enable_retry_client      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.enable_socket_keepalive  = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.enabled                  = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.expiration_time          = 600 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack sudo[76126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.hashclient_retry_attempts = 2 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_dead_retry      = 300 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_sasl_enabled    = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.password                 = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.proxies                  = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.redis_db                 = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.redis_server             = localhost:6379 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.retry_attempts           = 2 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.retry_delay              = 0.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.socket_keepalive_count   = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.socket_keepalive_idle    = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.socket_keepalive_interval = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.socket_timeout           = 1.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.tls_allowed_ciphers      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.tls_cafile               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.tls_certfile             = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.tls_enabled              = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.tls_keyfile              = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cache.username                 = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] coordination.backend_url       = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.asyncio_connection    = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.asyncio_slave_connection = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.backend               = sqlalchemy {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.connection            = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.connection_debug      = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.connection_parameters =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.connection_recycle_time = 3600 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.connection_trace      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.db_inc_retry_interval = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.db_max_retries        = 20 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.db_max_retry_interval = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.db_retry_interval     = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.max_overflow          = 50 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.max_pool_size         = 5 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.max_retries           = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.mysql_wsrep_sync_wait = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.pool_timeout          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.retry_interval        = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.slave_connection      = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.sqlite_synchronous    = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.synchronous_reader    = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] database.use_db_reconnect      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_tracing.insecure = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.connection_string     = messaging:// {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.enabled               = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.es_doc_type           = notification {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.es_scroll_size        = 10000 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.es_scroll_time        = 2m {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.filter_error_trace    = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.hmac_keys             = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.sentinel_service_name = mymaster {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.socket_timeout        = 0.1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.trace_requests        = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler.trace_sqlalchemy      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler_jaeger.process_tags   = {} {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler_jaeger.service_name_prefix = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] profiler_otlp.service_name_prefix = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.enforce_new_defaults = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.policy_default_rule = default {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.group          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.helper_command = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] privsep_osbrick.user           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.group         = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.helper_command = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] cinder_sys_admin.user          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.auth_section      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.auth_type         = password {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.cafile            = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.certfile          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.collect_timing    = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.insecure          = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.keyfile           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.send_service_user_token = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.split_loggers     = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.timeout           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.tls_ciphers       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] service_user.tls_min_version   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.auth_section            = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.auth_type               = password {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.certfile                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.collect_timing          = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.insecure                = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.keyfile                 = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.region_name             = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.split_loggers           = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.timeout                 = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.tls_ciphers             = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] glance.tls_min_version         = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.backend_availability_zone = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.chap_password = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.chap_username =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.disk_geometry = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_client_cert = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_client_cert_key = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_data_namespace = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.driver_use_ssl = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.extra_capabilities = {} {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.filter_function = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.goodness_function = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iscsi_target_flags =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iscsi_write_cache = on {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iser_helper   = tgtadm {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iser_port     = 3260 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.lvm_share_target = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.lvm_type      = auto {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.num_shell_tries = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.replication_device = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.report_discard_supported = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.reserved_percentage = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_helper = tgtadm {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_port   = 3260 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_protocol = iscsi {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.trace_flags   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.unique_fqdn_network = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.use_chap_auth = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_backend_name = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_clear  = zero {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_clear_ionice = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_clear_size = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_reports.file_event_handler = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_reports.log_dir           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.backend_host       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.chap_password      = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.chap_username      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.disk_geometry      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_client_cert = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.extra_capabilities = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.filter_function    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.goodness_function  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iser_helper        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iser_ip_address    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iser_port          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.lvm_share_target   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.lvm_type           = auto {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.num_shell_tries    = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.replication_device = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.report_discard_supported = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.reserved_percentage = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.scst_target_driver = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.storage_protocol   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_helper      = lioadm {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_ip_address  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_port        = 3260 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.trace_flags        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.use_chap_auth      = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_clear       = zero {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_clear_size  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] lvmdriver-1.volumes_dir        = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_notifications.driver = [] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_notifications.retry = -1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] key_manager.fixed_key          = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.barbican_api_version  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.barbican_endpoint     = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.barbican_endpoint_type = public {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.barbican_region_name  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.cafile                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.certfile              = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.collect_timing        = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.insecure              = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.keyfile               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.number_of_retries     = 60 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.retry_delay           = 1 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.send_service_user_token = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.split_loggers         = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.timeout               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.tls_ciphers           = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.tls_min_version       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.verify_ssl            = True {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican.verify_ssl_path       = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.auth_section = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.auth_type = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.cafile   = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.certfile = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.collect_timing = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.insecure = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.keyfile  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.split_loggers = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.timeout  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.tls_ciphers = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] barbican_service_user.tls_min_version = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.approle_role_id          = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.approle_secret_id        = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.auth_method              = approle {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.auth_path                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.kv_mountpoint            = secret {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.kv_path                  = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.kv_version               = 2 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.namespace                = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.root_token_id            = **** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.ssl_ca_crt_file          = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.timeout                  = 60.0 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.token_file               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.token_role               = None {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.use_ssl                  = False {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:55:23 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] ******************************************************************************** {{(pid=75957) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 16:55:23 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack sudo[76134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:23 devstack sudo[76134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:23 devstack sudo[76134]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.269s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 16:55:23 devstack cinder-volume[76121]: INFO cinder.brick.local_dev.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:24 devstack sudo[76141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:24 devstack sudo[76141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:24 devstack sudo[76141]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG cinder.brick.local_dev.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76121) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:24 devstack sudo[76223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:24 devstack sudo[76223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:24 devstack sudo[76223]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:24 devstack sudo[76453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:24 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:25 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:25 devstack sudo[76565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 25 16:55:25 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:25 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.242s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:25 devstack sudo[76658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:25 devstack sudo[76658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:25 devstack sudo[76658]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:25 devstack sudo[76742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:25 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:25 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:25 devstack sudo[76748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:25 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:26 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:26 devstack sudo[76828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:26 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:26 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:26 devstack sudo[76838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:26 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:26 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:26 devstack cinder-volume[76121]: INFO cinder.volume.drivers.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:26 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:26 devstack sudo[76922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:26 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:27 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:27 devstack sudo[76925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:27 devstack sudo[76925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:27 devstack sudo[76925]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:27 devstack sudo[76934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:27 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:27 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:27 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:27 devstack sudo[76937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:27 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:28 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:28 devstack sudo[76940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:28 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:28 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:28 devstack cinder-volume[76121]: INFO cinder.volume.driver [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG cinder.volume.driver [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76121) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_db.sqlalchemy.engines [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76121) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writer thread running {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG cinder.db.api [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Building query based on filter {{(pid=76121) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG cinder.image.image_utils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76121) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 16:55:28 devstack cinder-volume[76121]: INFO cinder.keymgr.migration [None req-2032e4c1-f7af-40d2-86d0-c8d46f2d48db None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:28 devstack sudo[76944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:28 devstack sudo[76944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:28 devstack sudo[76944]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:28 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:28 devstack sudo[76948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:28 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:29 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:29 devstack sudo[76952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:29 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:29 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:29 devstack sudo[76956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:29 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:29 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 16:55:29 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Driver initialization completed successfully.
Sep 25 16:55:29 devstack cinder-volume[76121]: INFO cinder.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Initiating service 2 cleanup
Sep 25 16:55:29 devstack cinder-volume[76121]: INFO cinder.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Service 2 cleanup completed.
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG cinder.service [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Creating RPC server for service cinder-volume {{(pid=76121) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG cinder.service [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76121) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 16:55:29 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:55:29 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:29 devstack sudo[76960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:55:29 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:30 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:30 devstack sudo[76963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:30 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:30 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:30 devstack sudo[76966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:55:30 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:30 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:55:30 devstack sudo[76970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:55:30 devstack sudo[76970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:55:30 devstack sudo[76970]: pam_unix(sudo:session): session closed for user root
Sep 25 16:55:30 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:55:30 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-b5ddd54d-4891-412c-b08d-66b5318bb7b3 None None] Driver post RPC initialization completed successfully.
Sep 25 16:55:31 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:55:31 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 16:55:31 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread info: [<_MainThread(MainThread, started 130606836248704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130606724652352)>, <Thread(Thread-3 (stat_writer), started daemon 130606722058048)>, <Thread(Rabbit-heartbeat, started daemon 130606720946176)>, <Thread(Thread-5 (_runner), started daemon 130606720991680)>, <Thread(Thread-7 (_runner), started daemon 130606721141696)>] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 16:55:33 devstack cinder-volume[75957]: DEBUG dbcounter [-] [75957] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75957) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:55:39 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:55:40 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:56:31 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:56:31 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:56:31 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:56:31 devstack sudo[79001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:56:31 devstack sudo[79001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:56:32 devstack sudo[79001]: pam_unix(sudo:session): session closed for user root
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:56:32 devstack sudo[79004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:56:32 devstack sudo[79004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:56:32 devstack sudo[79004]: pam_unix(sudo:session): session closed for user root
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:56:32 devstack sudo[79007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:56:32 devstack sudo[79007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:56:32 devstack sudo[79007]: pam_unix(sudo:session): session closed for user root
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:56:32 devstack sudo[79010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:56:32 devstack sudo[79010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:56:32 devstack sudo[79010]: pam_unix(sudo:session): session closed for user root
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 16:56:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread info: [<_MainThread(MainThread, started 130606836248704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130606724652352)>, <Thread(Thread-3 (stat_writer), started daemon 130606722058048)>, <Thread(Rabbit-heartbeat, started daemon 130606720946176)>, <Thread(Thread-5 (_runner), started daemon 130606720991680)>, <Thread(Thread-7 (_runner), started daemon 130606721141696)>] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 16:57:31 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:57:31 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:57:31 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:57:31 devstack sudo[82361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:57:31 devstack sudo[82361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:57:32 devstack sudo[82361]: pam_unix(sudo:session): session closed for user root
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:57:32 devstack sudo[82380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:57:32 devstack sudo[82380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:57:32 devstack sudo[82380]: pam_unix(sudo:session): session closed for user root
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:57:32 devstack sudo[82383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:57:32 devstack sudo[82383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:57:32 devstack sudo[82383]: pam_unix(sudo:session): session closed for user root
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:57:32 devstack sudo[82387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:57:32 devstack sudo[82387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:57:32 devstack sudo[82387]: pam_unix(sudo:session): session closed for user root
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 16:57:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread info: [<_MainThread(MainThread, started 130606836248704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130606724652352)>, <Thread(Thread-3 (stat_writer), started daemon 130606722058048)>, <Thread(Rabbit-heartbeat, started daemon 130606720946176)>, <Thread(Thread-5 (_runner), started daemon 130606720991680)>, <Thread(Thread-7 (_runner), started daemon 130606721141696)>] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 16:57:40 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:57:40 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:58:31 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:58:31 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:58:31 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:58:31 devstack sudo[84404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:58:31 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:58:32 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:58:32 devstack sudo[84407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:58:32 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:58:32 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:58:32 devstack sudo[84410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:58:32 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:58:32 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:58:32 devstack sudo[84413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:58:32 devstack sudo[84413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:58:32 devstack sudo[84413]: pam_unix(sudo:session): session closed for user root
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 16:58:32 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] thread info: [<_MainThread(MainThread, started 130606836248704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130606724652352)>, <Thread(Thread-3 (stat_writer), started daemon 130606722058048)>, <Thread(Rabbit-heartbeat, started daemon 130606720946176)>, <Thread(Thread-5 (_runner), started daemon 130606720991680)>, <Thread(Thread-7 (_runner), started daemon 130606721141696)>] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 16:59:31 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 16:59:31 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 16:59:31 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:31 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 16:59:31 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:32 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:32 devstack sudo[85616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:59:32 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:32 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:32 devstack sudo[85620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 16:59:32 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:32 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:32 devstack sudo[85624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 16:59:32 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:32 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:32 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-a3be12b3-b03d-4896-b0d0-e09f1ce64c06 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 16:59:40 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:59:40 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 16:59:51 devstack cinder-volume[75957]: INFO oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Caught SIGTERM, stopping children
Sep 25 16:59:51 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Acquiring lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 16:59:51 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Acquired lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 16:59:51 devstack cinder-volume[75957]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Releasing lock "singleton_lock" {{(pid=75957) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 16:59:51 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Stop services. {{(pid=75957) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 16:59:51 devstack cinder-volume[75957]: DEBUG oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Killing children. {{(pid=75957) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 16:59:51 devstack cinder-volume[75957]: INFO oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Waiting on 1 children to exit
Sep 25 16:59:54 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Acquiring lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 16:59:54 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Acquired lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 16:59:54 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Releasing lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 16:59:54 devstack cinder-volume[76121]: WARNING amqp [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 16:59:54 devstack cinder-volume[76121]: WARNING amqp [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 16:59:54 devstack cinder-volume[75957]: INFO oslo_service.backend._eventlet.service [None req-fcf7937e-aeba-4fa1-a858-851cf2ebdd2b None None] Child 76121 exited with status 0
Sep 25 16:59:55 devstack cinder-volume[86116]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 16:59:55 devstack cinder-volume[86116]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 16:59:55 devstack cinder-volume[86116]: we strongly recommend against using it for new projects.
Sep 25 16:59:55 devstack cinder-volume[86116]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 16:59:55 devstack cinder-volume[86116]: framework.  For more detail see
Sep 25 16:59:55 devstack cinder-volume[86116]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 16:59:55 devstack cinder-volume[86116]:   import eventlet  # noqa
Sep 25 16:59:57 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 16:59:57 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 16:59:57 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 16:59:57 devstack cinder-volume[86116]: INFO dbcounter [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Registered counter for database cinder
Sep 25 16:59:57 devstack cinder-volume[86116]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG dbcounter [-] [86116] Writer thread running {{(pid=86116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO cinder.rpc [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO cinder.rpc [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO cinder.volume.manager [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Determined volume DB was empty at startup.
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG cinder.volume.manager [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86116) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO cinder.volume.manager [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 16:59:58 devstack cinder-volume[86116]: WARNING stevedore.named [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 16:59:58 devstack cinder-volume[86116]: WARNING castellan.key_manager [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 16:59:58 devstack cinder-volume[86116]: WARNING cinder.keymgr.conf_key_mgr [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO cinder.volume.manager [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_db.sqlalchemy.engines [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:59:58 devstack cinder-volume[86116]: INFO oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Starting 1 workers
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Started child 86329 {{(pid=86116) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Full set of CONF: {{(pid=86116) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] ******************************************************************************** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Configuration options gathered from: {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] ================================================================================ {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] allow_availability_zone_fallback = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86329]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] allow_compression_on_image_upload = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] allowed_direct_url_schemes     = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] api_rate_limit                 = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] auth_strategy                  = keystone {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_availability_zone      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_host                   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_name                   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_stats_polling_interval = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backup_api_class               = cinder.backup.api.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backup_name_template           = backup-%s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backup_use_same_host           = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backup_use_temp_snapshot       = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] chap_password                  = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] chap_username                  =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_internal_tenant_project_id = 6ca37efaf4f940f6a34d394ce7b0fc91 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_internal_tenant_user_id = b4f0d62bf36147868e296a54c08f13d6 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cluster                        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] compression_format             = gzip {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] config_dir                     = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] config_source                  = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] control_exchange               = openstack {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] debug                          = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] default_availability_zone      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] default_group_type             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] default_volume_type            = QuobyteHD {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] disk_geometry                  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_client_cert             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_client_cert_key         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_data_namespace          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_ssl_cert_path           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_ssl_cert_verify         = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] driver_use_ssl                 = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] enable_new_services            = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] enable_unsupported_driver      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] enforce_multipath_for_image_xfer = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] filter_function                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_api_insecure            = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_api_servers             = ['http://192.168.122.76/image'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_api_ssl_compression     = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_ca_certificates_file    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_certfile                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_keyfile                 = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_num_retries             = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance_request_timeout         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] goodness_function              = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] graceful_shutdown_timeout      = 5 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] group_api_class                = cinder.group.api.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] host                           = devstack {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_compress_on_upload       = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_conversion_address_space_limit = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_conversion_cpu_limit     = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_conversion_disable       = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_introspection_address_space_limit = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_introspection_cpu_limit  = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_upload_use_cinder_backend = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_upload_use_internal_tenant = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_volume_cache_enabled     = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_volume_cache_max_count   = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] image_volume_cache_max_size_gb = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] init_host_max_objects_retrieval = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iscsi_target_flags             =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iscsi_write_cache              = on {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iser_helper                    = tgtadm {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iser_ip_address                = 192.168.122.76 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iser_port                      = 3260 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_color                      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_config_append              = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_dir                        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_file                       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_options                    = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_rotate_interval            = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_rotate_interval_type       = days {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] log_rotation_type              = none {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] max_age                        = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] max_logfile_count              = 30 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] max_logfile_size_mb            = 200 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] max_over_subscription_ratio    = 20.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] message_reap_interval          = 86400 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] message_ttl                    = 2592000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] migration_create_volume_timeout_secs = 300 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] monkey_patch                   = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] monkey_patch_modules           = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] my_ip                          = 192.168.122.76 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] no_snapshot_gb_quota           = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] num_iser_scan_tries            = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] num_shell_tries                = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86329]: INFO cinder.volume.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 16:59:58 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.remotefs [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86329) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] num_volume_device_scan_tries   = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] nvmeof_conn_info_version       = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] nvmet_ns_id                    = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] nvmet_port_id                  = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_max_limit                = 1000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_ext_list          = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_listen_port       = 8776 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_use_ssl           = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] osapi_volume_workers           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] per_volume_size_limit          = -1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] periodic_fuzzy_delay           = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] periodic_interval              = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] public_endpoint                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] publish_errors                 = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_backup_gigabytes         = 1000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_backups                  = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_gigabytes                = 1000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_groups                   = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_snapshots                = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] quota_volumes                  = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] rate_limit_burst               = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] rate_limit_except_level        = CRITICAL {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] rate_limit_interval            = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] reinit_driver_count            = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] replication_device             = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] report_discard_supported       = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] report_interval                = 120 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] reservation_clean_interval     = 86400 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] reservation_expire             = 86400 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] reserved_image_namespaces      = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] reserved_percentage            = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] rpc_response_timeout           = 120 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] run_external_periodic_tasks    = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] scst_target_driver             = iscsi {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] scst_target_iqn_name           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_down_time              = 720 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] shell_completion               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] snapshot_name_template         = snapshot-%s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] split_loggers                  = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] state_path                     = /opt/stack/data/cinder {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] storage_availability_zone      = nova {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] storage_protocol               = iSCSI {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] syslog_log_facility            = LOG_USER {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_helper                  = lioadm {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_ip_address              = 192.168.122.76 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_port                    = 3260 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_protocol                = iscsi {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] target_secondary_ip_addresses  = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] trace_flags                    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] transport_url                  = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] until_refresh                  = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_chap_auth                  = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_default_quota_class        = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_journal                    = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_json                       = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_multipath_for_image_xfer   = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_stderr                     = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] use_syslog                     = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] verify_glance_signatures       = enabled {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_api_class               = cinder.volume.api.API {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_backend_name            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_clear                   = zero {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_clear_ionice            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_clear_size              = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_copy_bps_limit          = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_dd_blocksize            = 1M {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_name_template           = volume-%s {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_service_inithost_offload = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volume_usage_audit_period      = month {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] zoning_mode                    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_concurrency.disable_process_locking = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.auth_section = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.auth_type   = password {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.auth_version = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.cache       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.certfile    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.include_service_catalog = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.insecure    = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.interface   = public {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.keyfile     = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_password = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcache_username = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.region_name = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.service_type = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.backend                  = dogpile.cache.null {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.backend_argument         = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.backend_expiration_time  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.config_prefix            = cache.oslo {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.debug_cache_backend      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.enable_retry_client      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.enable_socket_keepalive  = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.enabled                  = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.expiration_time          = 600 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.hashclient_retry_attempts = 2 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_dead_retry      = 300 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86329) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_sasl_enabled    = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.password                 = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.proxies                  = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.redis_db                 = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.redis_server             = localhost:6379 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.retry_attempts           = 2 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.retry_delay              = 0.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.socket_keepalive_count   = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.socket_keepalive_idle    = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.socket_keepalive_interval = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.socket_timeout           = 1.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.tls_allowed_ciphers      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.tls_cafile               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.tls_certfile             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.tls_enabled              = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.tls_keyfile              = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86329]: WARNING cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 16:59:58 devstack cinder-volume[86329]: WARNING cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cache.username                 = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Running cmd (subprocess): mount.quobyte {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] coordination.backend_url       = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.asyncio_connection    = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.asyncio_slave_connection = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.backend               = sqlalchemy {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.connection            = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.connection_debug      = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.connection_parameters =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.connection_recycle_time = 3600 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.connection_trace      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.db_inc_retry_interval = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.db_max_retries        = 20 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.db_max_retry_interval = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.db_retry_interval     = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.max_overflow          = 50 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.max_pool_size         = 5 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.max_retries           = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.mysql_wsrep_sync_wait = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.pool_timeout          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.retry_interval        = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.slave_connection      = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.sqlite_synchronous    = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.synchronous_reader    = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] database.use_db_reconnect      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_tracing.insecure = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.connection_string     = messaging:// {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.enabled               = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.es_doc_type           = notification {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.es_scroll_size        = 10000 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.es_scroll_time        = 2m {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.filter_error_trace    = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.hmac_keys             = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.sentinel_service_name = mymaster {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.socket_timeout        = 0.1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.trace_requests        = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler.trace_sqlalchemy      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler_jaeger.process_tags   = {} {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler_jaeger.service_name_prefix = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] profiler_otlp.service_name_prefix = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.enforce_new_defaults = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.policy_default_rule = default {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.group          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.helper_command = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] privsep_osbrick.user           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.group         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.helper_command = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] cinder_sys_admin.user          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.auth_section      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.auth_type         = password {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.cafile            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.certfile          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.collect_timing    = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.insecure          = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.keyfile           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.send_service_user_token = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.split_loggers     = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.timeout           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.tls_ciphers       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] service_user.tls_min_version   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.auth_section            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.auth_type               = password {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.certfile                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.collect_timing          = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.insecure                = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.keyfile                 = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.region_name             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.split_loggers           = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.timeout                 = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.tls_ciphers             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] glance.tls_min_version         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.backend_availability_zone = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.chap_password = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:58 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.chap_username =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.disk_geometry = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_client_cert = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_client_cert_key = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_data_namespace = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.driver_use_ssl = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.extra_capabilities = {} {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.filter_function = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.goodness_function = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iscsi_target_flags =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iscsi_write_cache = on {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iser_port     = 3260 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_host      =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_login     = admin {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_mount_options = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_password  = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_private_key =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_share_path =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.num_shell_tries = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack quobyte-client[86332]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.quobyte_volume_url = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.replication_device = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.report_discard_supported = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack quobyte-client[86332]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.reserved_percentage = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_helper = tgtadm {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_port   = 3260 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_protocol = iscsi {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.trace_flags   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: INFO cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 ...
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.unique_fqdn_network = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.use_chap_auth = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_backend_name = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_clear  = zero {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_clear_ionice = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_clear_size = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c -c /etc/quobyte/client-cinder.cfg {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_reports.file_event_handler = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_reports.log_dir           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.backend_availability_zone = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.backend_host         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.chap_password        = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.chap_username        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.disk_geometry        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_client_cert   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_data_namespace = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.extra_capabilities   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.filter_function      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.goodness_function    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iser_helper          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iser_ip_address      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iser_port            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_host             = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_login            = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_mount_options    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_password         = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_private_key      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_share_path       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.num_shell_tries      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.replication_device   = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.report_discard_supported = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.reserved_percentage  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.scst_target_driver   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.storage_protocol     = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_helper        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_ip_address    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_port          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_prefix        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_protocol      = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.trace_flags          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.use_chap_auth        = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_clear         = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_clear_size    = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] QuobyteHD.volumes_dir          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c -c /etc/quobyte/client-cinder.cfg
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_notifications.driver = [] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_notifications.retry = -1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] key_manager.fixed_key          = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.barbican_api_version  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.barbican_endpoint     = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.barbican_endpoint_type = public {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.barbican_region_name  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.cafile                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.certfile              = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.collect_timing        = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.insecure              = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.keyfile               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.number_of_retries     = 60 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.retry_delay           = 1 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.send_service_user_token = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.split_loggers         = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.timeout               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.tls_ciphers           = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.tls_min_version       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.verify_ssl            = True {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican.verify_ssl_path       = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.auth_section = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.auth_type = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.cafile   = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.certfile = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.collect_timing = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.insecure = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.keyfile  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.split_loggers = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.timeout  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.tls_ciphers = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] barbican_service_user.tls_min_version = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.approle_role_id          = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.approle_secret_id        = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.auth_method              = approle {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.auth_path                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.kv_mountpoint            = secret {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.kv_path                  = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.kv_version               = 2 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.namespace                = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.root_token_id            = **** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.ssl_ca_crt_file          = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.timeout                  = 60.0 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.token_file               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.token_role               = None {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.use_ssl                  = False {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 16:59:59 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] ******************************************************************************** {{(pid=86116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 16:59:59 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.429s {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:59 devstack cinder-volume[86329]: INFO cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 succeeded
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.443s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:59 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 16:59:59 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 16:59:59 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.241s {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 16:59:59 devstack cinder-volume[86329]: INFO cinder.volume.driver [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.volume.driver [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86329) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_db.sqlalchemy.engines [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG dbcounter [-] [86329] Writer thread running {{(pid=86329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.db.api [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Building query based on filter {{(pid=86329) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.image.image_utils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86329) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 16:59:59 devstack cinder-volume[86329]: INFO cinder.keymgr.migration [None req-0825e34a-8b05-46e8-a94e-f996dd4056f8 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 16:59:59 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 16:59:59 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 16:59:59 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:00:00 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.230s {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG cinder.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Notifying Schedulers of capabilities ... {{(pid=86329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:00:00 devstack cinder-volume[86329]: INFO cinder.volume.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Driver initialization completed successfully.
Sep 25 17:00:00 devstack cinder-volume[86329]: INFO cinder.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Initiating service 3 cleanup
Sep 25 17:00:00 devstack cinder-volume[86329]: INFO cinder.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Service 3 cleanup completed.
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG cinder.service [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Creating RPC server for service cinder-volume {{(pid=86329) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG cinder.service [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86329) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 17:00:00 devstack cinder-volume[86329]: INFO cinder.volume.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG cinder.volume.drivers.quobyte [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:00:00 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:00:00 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:00:00 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Sep 25 17:00:00 devstack cinder-volume[86329]: DEBUG oslo_concurrency.processutils [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.239s {{(pid=86329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:00 devstack cinder-volume[86329]: INFO cinder.volume.manager [None req-858e7e1e-50b2-481b-b6d0-9b07166eb3ad None None] Driver post RPC initialization completed successfully.
Sep 25 17:00:04 devstack cinder-volume[86116]: INFO oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Caught SIGTERM, stopping children
Sep 25 17:00:04 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Acquiring lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 17:00:04 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Acquired lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 17:00:04 devstack cinder-volume[86116]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Releasing lock "singleton_lock" {{(pid=86116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 17:00:04 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Stop services. {{(pid=86116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 17:00:04 devstack cinder-volume[86116]: DEBUG oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Killing children. {{(pid=86116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 17:00:04 devstack cinder-volume[86116]: INFO oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Waiting on 1 children to exit
Sep 25 17:00:08 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Acquiring lock "singleton_lock" {{(pid=86329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 17:00:08 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Acquired lock "singleton_lock" {{(pid=86329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 17:00:08 devstack cinder-volume[86329]: DEBUG oslo_concurrency.lockutils [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Releasing lock "singleton_lock" {{(pid=86329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 17:00:08 devstack cinder-volume[86329]: WARNING amqp [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 17:00:08 devstack cinder-volume[86329]: WARNING amqp [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 17:00:08 devstack cinder-volume[86116]: INFO oslo_service.backend._eventlet.service [None req-e0dd96ad-5e71-400e-8668-79cc3ed4b051 None None] Child 86329 exited with status 0
Sep 25 17:00:09 devstack cinder-volume[86647]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 17:00:09 devstack cinder-volume[86647]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 17:00:09 devstack cinder-volume[86647]: we strongly recommend against using it for new projects.
Sep 25 17:00:09 devstack cinder-volume[86647]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 17:00:09 devstack cinder-volume[86647]: framework.  For more detail see
Sep 25 17:00:09 devstack cinder-volume[86647]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 17:00:09 devstack cinder-volume[86647]:   import eventlet  # noqa
Sep 25 17:00:11 devstack cinder-volume[86647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86647) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 17:00:11 devstack cinder-volume[86647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86647) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 17:00:11 devstack cinder-volume[86647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86647) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 17:00:12 devstack cinder-volume[86647]: INFO dbcounter [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Registered counter for database cinder
Sep 25 17:00:12 devstack cinder-volume[86647]: DEBUG oslo_db.sqlalchemy.engines [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86647) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG dbcounter [-] [86647] Writer thread running {{(pid=86647) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 17:00:13 devstack cinder-volume[86647]: INFO cinder.rpc [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 17:00:13 devstack cinder-volume[86647]: INFO cinder.rpc [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_db.sqlalchemy.engines [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86647) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 17:00:13 devstack cinder-volume[86647]: INFO cinder.volume.manager [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Determined volume DB was empty at startup.
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG cinder.volume.manager [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86647) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 17:00:13 devstack cinder-volume[86647]: WARNING stevedore.named [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 17:00:13 devstack cinder-volume[86647]: WARNING castellan.key_manager [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 17:00:13 devstack cinder-volume[86647]: WARNING cinder.keymgr.conf_key_mgr [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 17:00:13 devstack cinder-volume[86647]: INFO cinder.volume.manager [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_db.sqlalchemy.engines [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86647) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 17:00:13 devstack cinder-volume[86647]: INFO oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Starting 1 workers
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Started child 86955 {{(pid=86647) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Full set of CONF: {{(pid=86647) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] ******************************************************************************** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] Configuration options gathered from: {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] ================================================================================ {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] allow_availability_zone_fallback = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] allow_compression_on_image_upload = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] allowed_direct_url_schemes     = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] api_rate_limit                 = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] auth_strategy                  = keystone {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_availability_zone      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_host                   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_name                   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_stats_polling_interval = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backup_api_class               = cinder.backup.api.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backup_name_template           = backup-%s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backup_use_same_host           = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backup_use_temp_snapshot       = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86955]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] chap_password                  = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] chap_username                  =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_internal_tenant_project_id = 6ca37efaf4f940f6a34d394ce7b0fc91 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_internal_tenant_user_id = b4f0d62bf36147868e296a54c08f13d6 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cluster                        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] compression_format             = gzip {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] compute_api_class              = cinder.compute.nova.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] config_dir                     = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] config_source                  = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] control_exchange               = openstack {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] debug                          = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] default_availability_zone      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] default_group_type             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] default_volume_type            = QuobyteHD {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] disk_geometry                  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_client_cert             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_client_cert_key         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_data_namespace          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_ssl_cert_path           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_ssl_cert_verify         = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] driver_use_ssl                 = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] enable_new_services            = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] enable_unsupported_driver      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] enabled_backends               = ['QuobyteHD'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] enforce_multipath_for_image_xfer = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] filter_function                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_api_insecure            = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_api_servers             = ['http://192.168.122.76/image'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_api_ssl_compression     = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_ca_certificates_file    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_catalog_info            = image:glance:publicURL {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_certfile                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_keyfile                 = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_num_retries             = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance_request_timeout         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] goodness_function              = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] graceful_shutdown_timeout      = 5 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] group_api_class                = cinder.group.api.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] host                           = devstack {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_compress_on_upload       = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_conversion_address_space_limit = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_conversion_cpu_limit     = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_conversion_disable       = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_introspection_address_space_limit = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_introspection_cpu_limit  = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_upload_use_cinder_backend = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_upload_use_internal_tenant = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_volume_cache_enabled     = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_volume_cache_max_count   = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] image_volume_cache_max_size_gb = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] init_host_max_objects_retrieval = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] instance_format                = [instance: %(uuid)s]  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iscsi_target_flags             =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iscsi_write_cache              = on {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iser_helper                    = tgtadm {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iser_ip_address                = 192.168.122.76 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iser_port                      = 3260 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_color                      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_config_append              = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_dir                        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_file                       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_options                    = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_rotate_interval            = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_rotate_interval_type       = days {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] log_rotation_type              = none {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] max_age                        = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] max_logfile_count              = 30 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] max_logfile_size_mb            = 200 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] max_over_subscription_ratio    = 20.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] message_reap_interval          = 86400 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] message_ttl                    = 2592000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] migration_create_volume_timeout_secs = 300 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] monkey_patch                   = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] monkey_patch_modules           = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] my_ip                          = 192.168.122.76 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] no_snapshot_gb_quota           = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] num_iser_scan_tries            = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] num_shell_tries                = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] num_volume_device_scan_tries   = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] nvmeof_conn_info_version       = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] nvmet_ns_id                    = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] nvmet_port_id                  = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_max_limit                = 1000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_ext_list          = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_listen_port       = 8776 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_use_ssl           = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] osapi_volume_workers           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] per_volume_size_limit          = -1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] periodic_fuzzy_delay           = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] periodic_interval              = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] public_endpoint                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] publish_errors                 = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_backup_gigabytes         = 1000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_backups                  = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_gigabytes                = 1000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_groups                   = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_snapshots                = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] quota_volumes                  = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] rate_limit_burst               = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] rate_limit_except_level        = CRITICAL {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] rate_limit_interval            = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] reinit_driver_count            = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] replication_device             = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] report_discard_supported       = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] report_interval                = 120 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] reservation_clean_interval     = 86400 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] reservation_expire             = 86400 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] reserved_image_namespaces      = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] reserved_percentage            = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] rpc_response_timeout           = 120 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] run_external_periodic_tasks    = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] scst_target_driver             = iscsi {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] scst_target_iqn_name           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_down_time              = 720 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] shell_completion               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] snapshot_name_template         = snapshot-%s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] split_loggers                  = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] state_path                     = /opt/stack/data/cinder {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] storage_availability_zone      = nova {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] storage_protocol               = iSCSI {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] syslog_log_facility            = LOG_USER {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_helper                  = lioadm {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_ip_address              = 192.168.122.76 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_port                    = 3260 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_protocol                = iscsi {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] target_secondary_ip_addresses  = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] trace_flags                    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] transport_url                  = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] until_refresh                  = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_chap_auth                  = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_default_quota_class        = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92963be8-d934-49e9-9752-00a35d400090 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86955) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_journal                    = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_json                       = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_multipath_for_image_xfer   = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_stderr                     = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] use_syslog                     = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] verify_glance_signatures       = enabled {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_api_class               = cinder.volume.api.API {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_backend_name            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_clear                   = zero {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_clear_ionice            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_clear_size              = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_copy_bps_limit          = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_dd_blocksize            = 1M {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_name_template           = volume-%s {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_service_inithost_offload = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volume_usage_audit_period      = month {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] zoning_mode                    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_concurrency.disable_process_locking = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.auth_section = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.auth_type   = password {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.auth_version = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.cache       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.certfile    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.include_service_catalog = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.insecure    = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.interface   = public {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.keyfile     = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_password = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcache_username = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.region_name = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.service_type = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.backend                  = dogpile.cache.null {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.backend_argument         = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.backend_expiration_time  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.config_prefix            = cache.oslo {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.debug_cache_backend      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.enable_retry_client      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.enable_socket_keepalive  = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.enabled                  = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.expiration_time          = 600 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.hashclient_retry_attempts = 2 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_dead_retry      = 300 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_pool_maxsize    = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_sasl_enabled    = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.password                 = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.proxies                  = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.redis_db                 = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.redis_server             = localhost:6379 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.retry_attempts           = 2 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.retry_delay              = 0.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.socket_keepalive_count   = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.socket_keepalive_idle    = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.socket_keepalive_interval = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.socket_timeout           = 1.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.tls_allowed_ciphers      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.tls_cafile               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.tls_certfile             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.tls_enabled              = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.tls_keyfile              = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cache.username                 = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] coordination.backend_url       = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.asyncio_connection    = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.asyncio_slave_connection = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.backend               = sqlalchemy {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.connection            = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.connection_debug      = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.connection_parameters =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.connection_recycle_time = 3600 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.connection_trace      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.db_inc_retry_interval = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.db_max_retries        = 20 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.db_max_retry_interval = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.db_retry_interval     = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.max_overflow          = 50 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.max_pool_size         = 5 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.max_retries           = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.mysql_wsrep_sync_wait = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.pool_timeout          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.retry_interval        = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.slave_connection      = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.sqlite_synchronous    = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.synchronous_reader    = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] database.use_db_reconnect      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_tracing.insecure = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.connection_string     = messaging:// {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.enabled               = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.es_doc_type           = notification {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.es_scroll_size        = 10000 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.es_scroll_time        = 2m {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.filter_error_trace    = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.hmac_keys             = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.sentinel_service_name = mymaster {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.socket_timeout        = 0.1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.trace_requests        = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler.trace_sqlalchemy      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler_jaeger.process_tags   = {} {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler_jaeger.service_name_prefix = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] profiler_otlp.service_name_prefix = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.enforce_new_defaults = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.policy_default_rule = default {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.policy_file        = policy.yaml {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.group          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86955) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.helper_command = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] privsep_osbrick.user           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Running cmd (subprocess): mount.quobyte {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.group         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.helper_command = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] cinder_sys_admin.user          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.auth_section      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.auth_type         = password {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.cafile            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.certfile          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.collect_timing    = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.insecure          = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.keyfile           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.send_service_user_token = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.split_loggers     = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.timeout           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.tls_ciphers       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] service_user.tls_min_version   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.auth_section            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.auth_type               = password {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.certfile                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.collect_timing          = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.insecure                = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.keyfile                 = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.region_name             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.split_loggers           = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.timeout                 = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.tls_ciphers             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] glance.tls_min_version         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.backend_availability_zone = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.chap_password = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.chap_username =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.disk_geometry = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_client_cert = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_client_cert_key = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_data_namespace = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.driver_use_ssl = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.extra_capabilities = {} {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.filter_function = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.goodness_function = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iscsi_target_flags =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iscsi_write_cache = on {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iser_helper   = tgtadm {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iser_port     = 3260 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_host      =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_login     = admin {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_mount_options = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_password  = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_private_key =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_share_path =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.num_shell_tries = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.quobyte_volume_url = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.replication_device = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.report_discard_supported = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.reserved_percentage = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_helper = tgtadm {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_port   = 3260 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_protocol = iscsi {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.trace_flags   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.unique_fqdn_network = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.use_chap_auth = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_backend_name = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_clear  = zero {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_clear_ionice = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_clear_size = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_reports.file_event_handler = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_reports.log_dir           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.backend_availability_zone = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.backend_host         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.chap_password        = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.chap_username        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.chiscsi_conf         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.disk_geometry        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack quobyte-client[86956]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_client_cert   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_data_namespace = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack quobyte-client[86956]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.driver_use_ssl       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.extra_capabilities   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.filter_function      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.goodness_function    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iser_helper          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iser_ip_address      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iser_port            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.iser_target_prefix   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_host             = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_login            = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_mount_options    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_password         = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_private_key      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_share_path       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_ssh_port         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.num_shell_tries      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.nvmet_port_id        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.replication_device   = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.report_discard_supported = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.reserved_percentage  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.scst_target_driver   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.storage_protocol     = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_helper        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_ip_address    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_port          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_prefix        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_protocol      = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.trace_flags          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.use_chap_auth        = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_clear         = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_clear_size    = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] QuobyteHD.volumes_dir          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl      = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_notifications.driver = [] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_notifications.retry = -1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] key_manager.fixed_key          = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.barbican_api_version  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.barbican_endpoint     = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.barbican_endpoint_type = public {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.barbican_region_name  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.cafile                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.certfile              = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.collect_timing        = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.insecure              = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.keyfile               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.number_of_retries     = 60 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.retry_delay           = 1 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.send_service_user_token = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.split_loggers         = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.timeout               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.tls_ciphers           = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.tls_min_version       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.verify_ssl            = True {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican.verify_ssl_path       = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.auth_section = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.auth_type = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.cafile   = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.certfile = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.collect_timing = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.insecure = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.keyfile  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.split_loggers = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.timeout  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.tls_ciphers = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] barbican_service_user.tls_min_version = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.approle_role_id          = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.approle_secret_id        = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.auth_method              = approle {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.auth_path                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.kv_mountpoint            = secret {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.kv_path                  = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.kv_version               = 2 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.namespace                = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.root_token_id            = **** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.ssl_ca_crt_file          = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.timeout                  = 60.0 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.token_file               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.token_role               = None {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.use_ssl                  = False {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 17:00:13 devstack cinder-volume[86647]: DEBUG oslo_service.backend._eventlet.service [None req-f909e776-3c6b-4b07-9561-79be4c0dfc5b None None] ******************************************************************************** {{(pid=86647) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 17:00:13 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:13 devstack cinder-volume[86955]: INFO cinder.volume.driver [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.driver [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_db.sqlalchemy.engines [None req-92963be8-d934-49e9-9752-00a35d400090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writer thread running {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.db.api [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Building query based on filter {{(pid=86955) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86955) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:00:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:00:13 devstack cinder-volume[86955]: INFO cinder.keymgr.migration [None req-87956ee7-0b5c-4aff-a2fc-005c7d957a7f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 17:00:13 devstack sudo[86968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:00:13 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:00:14 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:00:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Driver initialization completed successfully.
Sep 25 17:00:14 devstack cinder-volume[86955]: INFO cinder.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Initiating service 3 cleanup
Sep 25 17:00:14 devstack cinder-volume[86955]: INFO cinder.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Service 3 cleanup completed.
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG cinder.service [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Creating RPC server for service cinder-volume {{(pid=86955) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG cinder.service [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86955) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 17:00:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:00:14 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:00:14 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:00:14 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Sep 25 17:00:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92963be8-d934-49e9-9752-00a35d400090 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.236s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:00:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92963be8-d934-49e9-9752-00a35d400090 None None] Driver post RPC initialization completed successfully.
Sep 25 17:00:23 devstack cinder-volume[86647]: DEBUG dbcounter [-] [86647] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86647) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:00:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:00:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:01:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:01:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 6 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:01:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:01:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-063023b7-4812-4c58-b288-cfa25c50f0b5 tempest-GroupsV314Test-23638119 None] Group tempest-GroupsV314Test-Group-1963054065: creating
Sep 25 17:01:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-063023b7-4812-4c58-b288-cfa25c50f0b5 tempest-GroupsV314Test-23638119 None] Group tempest-GroupsV314Test-Group-1963054065: created successfully
Sep 25 17:01:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-063023b7-4812-4c58-b288-cfa25c50f0b5 tempest-GroupsV314Test-23638119 None] Create group completed successfully.
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Flow 'volume_create_manager' (ff398d8c-34c8-4082-8b33-688f3db36779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1eaede-1e30-4904-98ae-98578db4383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1eaede-1e30-4904-98ae-98578db4383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743177851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8b7adf77-3c35-4198-8a3b-8c3aab201e54,host='devstack@QuobyteHD#QuobyteHD',id=1004aedc-a29e-4129-8c9f-78b602103fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9585da5815564615a27d808c9c7c2e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:16Z,use_quota=True,user_id='3d9be758438347d789dbb39d19981e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cec05a-52f6-4bef-99a7-72fd4c9ef1fd),volume_type_id=00cec05a-52f6-4bef-99a7-72fd4c9ef1fd)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54f522a-aed1-4e13-b9d3-332a62922c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54f522a-aed1-4e13-b9d3-332a62922c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b3c7b8-2d0b-4703-b973-468faa448122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b3c7b8-2d0b-4703-b973-468faa448122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1004aedc-a29e-4129-8c9f-78b602103fe4', 'volume_name': 'volume-1004aedc-a29e-4129-8c9f-78b602103fe4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e83d6f4-03c9-46c0-ac4c-5a147d25b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e83d6f4-03c9-46c0-ac4c-5a147d25b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672ab945-ae3b-4682-8a3c-658d6d17b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Volume 1004aedc-a29e-4129-8c9f-78b602103fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1004aedc-a29e-4129-8c9f-78b602103fe4', 'volume_size': 1}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8b7adf77-3c35-4198-8a3b-8c3aab201e54,created_at=2026-09-25T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743177851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8b7adf77-3c35-4198-8a3b-8c3aab201e54,host='devstack@QuobyteHD#QuobyteHD',id=1004aedc-a29e-4129-8c9f-78b602103fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9585da5815564615a27d808c9c7c2e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:16Z,use_quota=True,user_id='3d9be758438347d789dbb39d19981e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cec05a-52f6-4bef-99a7-72fd4c9ef1fd),volume_type_id=00cec05a-52f6-4bef-99a7-72fd4c9ef1fd)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Creating volume 1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:01:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:01:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:16 devstack sudo[87382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 1073741824
Sep 25 17:01:16 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:17 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 1073741824" returned: 0 in 0.818s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:17 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:17 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:17 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672ab945-ae3b-4682-8a3c-658d6d17b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1004aedc-a29e-4129-8c9f-78b602103fe4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd832e8-6c7c-43cc-ac31-c066301f2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Volume volume-1004aedc-a29e-4129-8c9f-78b602103fe4 (1004aedc-a29e-4129-8c9f-78b602103fe4): created successfully
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd832e8-6c7c-43cc-ac31-c066301f2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Flow 'volume_create_manager' (ff398d8c-34c8-4082-8b33-688f3db36779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ca98f015-84f3-446d-a547-abb09ba5f5db tempest-GroupsV314Test-23638119 None] Created volume successfully.
Sep 25 17:01:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:20 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Cloning volume 1004aedc-a29e-4129-8c9f-78b602103fe4 to volume cd760bc9-68c2-45d7-bd1c-cec1255cb2fa
Sep 25 17:01:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Creating offline snapshot 23f0836a-8a6d-4067-a8ba-905a78615481 of volume 1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:01:20 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpomj5n57j/privsep.sock']
Sep 25 17:01:20 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpomj5n57j/privsep.sock
Sep 25 17:01:20 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 17:01:22 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 25 17:01:23 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:23 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Spawned new privsep daemon via rootwrap
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Accepted privsep connection to /tmp/tmpomj5n57j/privsep.sock {{(pid=86955) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 25 17:01:23 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 25 17:01:23 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 25 17:01:23 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 25 17:01:23 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87860
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c216009-8e28-467f-95e3-d6a5f89e69c0]: (2,) {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6b3ebf-d69e-43c8-bf6d-fe99b1f9dd56]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:23 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:23 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:23 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:24 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 1G
Sep 25 17:01:24 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:24 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 1G" returned: 0 in 0.959s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1004aedc-a29e-4129-8c9f-78b602103fe4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:24 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1004aedc-a29e-4129-8c9f-78b602103fe4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:24 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:25 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1004aedc-a29e-4129-8c9f-78b602103fe4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:25 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:01:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:25 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:25 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:26 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 0.525s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:26 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info
Sep 25 17:01:26 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:26 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:26 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:27 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info
Sep 25 17:01:27 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:27 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.info" returned: 0 in 0.450s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Acquiring lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] snapshot: 23f0836a-8a6d-4067-a8ba-905a78615481, volume: cd760bc9-68c2-45d7-bd1c-cec1255cb2fa,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6260987a-aef4-4427-a8d1-ee6cc0a16eb9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:27 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:27 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:28 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 1.105s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1004aedc-a29e-4129-8c9f-78b602103fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:01:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[225da5e6-ada7-4ad0-bd96-605afdd5eb89]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:29 devstack sudo[88031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:29 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:30 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 1.206s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:01:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:01:30 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:01:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:30 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa
Sep 25 17:01:30 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Flow 'volume_create_manager' (d2512199-10e9-465d-9578-cf52a5ab1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba900630-408e-4781-81d2-687825aa2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba900630-408e-4781-81d2-687825aa2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-590681586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0a1bff-5cf5-4f3f-a78c-e75845dc68db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8989afd8373d4b9caea12a1bdbcf74f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:35Z,use_quota=True,user_id='87f158f867a647669ecc904f0830b14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf1568-1f39-41f7-b3a7-1eccf899108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf1568-1f39-41f7-b3a7-1eccf899108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b368394a-1aff-45e7-a554-4428392e181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b368394a-1aff-45e7-a554-4428392e181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0a1bff-5cf5-4f3f-a78c-e75845dc68db', 'volume_name': 'volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f9396-3f5e-407a-80f8-5d4543d6e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f9396-3f5e-407a-80f8-5d4543d6e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe5523-78d3-4427-b393-e9dbb3bc6f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Volume 8c0a1bff-5cf5-4f3f-a78c-e75845dc68db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db', 'volume_size': 1}
Sep 25 17:01:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:41 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" returned: 0 in 11.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:41 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4, size 1024.00 MB, duration 11.77 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:01:41 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Converted 1024.00 MB image at 87.04 MB/s
Sep 25 17:01:41 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:01:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:41 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa
Sep 25 17:01:41 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:42 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" returned: 0 in 0.252s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" released by "_copy_volume_from_snapshot" :: held 14.507s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Acquiring lock "cinder-quobyte-23f0836a-8a6d-4067-a8ba-905a78615481" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-23f0836a-8a6d-4067-a8ba-905a78615481" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Deleting offline snapshot 23f0836a-8a6d-4067-a8ba-905a78615481 of volume 1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] snapshot_file for this snap is: volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a40ec-e74a-4b26-9a73-7dab2917d7b6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:42 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:42 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:42 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 0.490s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1004aedc-a29e-4129-8c9f-78b602103fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b6cef9-d3a9-4cac-8102-2f1532b47313]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:42 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:42 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:43 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 0.640s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:43 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:43 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:43 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:43 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481
Sep 25 17:01:43 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:44 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4.23f0836a-8a6d-4067-a8ba-905a78615481" returned: 0 in 0.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-23f0836a-8a6d-4067-a8ba-905a78615481" released by "_delete_snapshot" :: held 1.990s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.823s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.634s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-590681586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0a1bff-5cf5-4f3f-a78c-e75845dc68db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8989afd8373d4b9caea12a1bdbcf74f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:35Z,use_quota=True,user_id='87f158f867a647669ecc904f0830b14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Creating volume 8c0a1bff-5cf5-4f3f-a78c-e75845dc68db {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:01:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:44 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db 1073741824
Sep 25 17:01:44 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1070357e-826b-4aa2-abb5-8e1e6490480c tempest-GroupsV314Test-23638119 None] Create group from source-group-8b7adf77-3c35-4198-8a3b-8c3aab201e54 completed successfully.
Sep 25 17:01:44 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db 1073741824" returned: 0 in 0.531s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:44 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db
Sep 25 17:01:44 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:45 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" returned: 0 in 0.333s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe5523-78d3-4427-b393-e9dbb3bc6f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaadee8d-3931-44fa-8234-183c33e842e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Volume volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db (8c0a1bff-5cf5-4f3f-a78c-e75845dc68db): created successfully
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaadee8d-3931-44fa-8234-183c33e842e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Flow 'volume_create_manager' (d2512199-10e9-465d-9578-cf52a5ab1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a136a519-ef01-4cbc-b6ae-f142445d78c7 tempest-VolumesAdminNegativeTest-1587064563 None] Created volume successfully.
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Acquiring lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[82998e07-8b80-4fd0-8b34-fd4d1f88d289]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:45 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa
Sep 25 17:01:45 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:46 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" returned: 0 in 0.442s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:46 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa
Sep 25 17:01:46 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:46 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" returned: 0 in 0.301s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-cd760bc9-68c2-45d7-bd1c-cec1255cb2fa" released by "delete_volume" :: held 0.812s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Created reservations ['ee1c81b2-b8d2-4512-867a-701e960a671f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:01:46 devstack cinder-volume[86955]: WARNING cinder.quota [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-301593574 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-301593574, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:01:46 devstack cinder-volume[86955]: WARNING cinder.quota [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-301593574 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-301593574, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Created reservations ['85eb5121-b280-479e-8de4-25c78eeb2171', 'a04f323f-96e6-4402-9e79-eb30ca983dcf', 'a2da0d8b-1c1f-487a-923e-b525f47f6954', '4f90bb7a-c24b-492c-b8aa-4d4e23682244'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Acquiring lock "cinder-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "cinder-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Acquiring lock "cinder-quobyte-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "cinder-quobyte-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b76d89-6da8-4e84-b58d-4032bdbc6ea0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:47 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:01:47 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:47 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db
Sep 25 17:01:47 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:47 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.392s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:01:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6f8eb1a3-8186-4ddf-a007-1fe371970c14 tempest-GroupsV314Test-23638119 None] Delete group completed successfully.
Sep 25 17:01:47 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" returned: 0 in 0.503s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:47 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db
Sep 25 17:01:47 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:47 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "cinder-quobyte-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db" released by "delete_volume" :: held 0.814s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:47 devstack cinder-volume[86955]: WARNING cinder.quota [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:01:47 devstack cinder-volume[86955]: WARNING cinder.quota [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Created reservations ['a44efdbd-18ed-42c3-87f0-6060d2674d5a', 'e9be3d21-a715-4be6-9a90-12826cb8616c', '3499caa2-c97d-41e9-8dc4-b6071a02fc0e', '2db128ee-0e95-4124-a273-3c8249a981ba'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:47 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:01:47 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:48 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:01:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Deleted volume successfully.
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07e8b0a4-f6ad-47dc-80ef-24543fd63b1e tempest-VolumesAdminNegativeTest-1587064563 None] Lock "cinder-8c0a1bff-5cf5-4f3f-a78c-e75845dc68db-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Acquiring lock "cinder-quobyte-1004aedc-a29e-4129-8c9f-78b602103fe4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-1004aedc-a29e-4129-8c9f-78b602103fe4" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8fb41a-4580-49f5-b2ce-930e713957b5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:48 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:48 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:48 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 0.425s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:48 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4
Sep 25 17:01:48 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:49 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1004aedc-a29e-4129-8c9f-78b602103fe4" returned: 0 in 0.341s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Lock "cinder-quobyte-1004aedc-a29e-4129-8c9f-78b602103fe4" released by "delete_volume" :: held 0.896s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Created reservations ['fec397a8-08ac-4311-af8a-f1ae326229cb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Created reservations ['53747a33-2a4d-455f-91fd-b09832449d99', '8d359e75-638a-4001-9b8f-bfbb21ab19b4', 'cb2a8e35-af9c-4639-8b5b-6ccbe15eefa4', '61510d0c-354b-48d2-a1e8-234651737cc0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:49 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:01:49 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:49 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.371s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:01:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-853918d7-ab0e-4c46-a03c-1c443294677c tempest-GroupsV314Test-23638119 None] Delete group completed successfully.
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (e5621db6-42bc-49fc-9c8f-890e56a869ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b255ad16-646b-4037-b1a2-3706d0e58246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b255ad16-646b-4037-b1a2-3706d0e58246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1999797987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8b5f2-e604-44c1-9aa3-9030bf397cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:51Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c026d1-de00-49d3-9413-3a537e3f1bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c026d1-de00-49d3-9413-3a537e3f1bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8d6e7-a43f-4ed2-8792-21dd6dad939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d8d6e7-a43f-4ed2-8792-21dd6dad939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce8b5f2-e604-44c1-9aa3-9030bf397cf9', 'volume_name': 'volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c51869-bfd9-4ca9-b532-aff7220c7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c51869-bfd9-4ca9-b532-aff7220c7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19df419-b873-480b-8455-9f25350c7080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Volume 8ce8b5f2-e604-44c1-9aa3-9030bf397cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9', 'volume_size': 1}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1999797987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8b5f2-e604-44c1-9aa3-9030bf397cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:51Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Creating volume 8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:01:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:01:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:51 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 1073741824
Sep 25 17:01:51 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:52 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 1073741824" returned: 0 in 0.590s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:01:52 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9
Sep 25 17:01:52 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:01:52 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" returned: 0 in 0.319s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19df419-b873-480b-8455-9f25350c7080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8670b5b4-c4e7-4dc8-a9b3-645ecec8cea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:01:52 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Volume volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 (8ce8b5f2-e604-44c1-9aa3-9030bf397cf9): created successfully
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8670b5b4-c4e7-4dc8-a9b3-645ecec8cea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:01:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (e5621db6-42bc-49fc-9c8f-890e56a869ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:01:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0c3fee6e-c429-4a1f-a546-b6d56b5bb44b tempest-AttachVolumeTestJSON-1056916763 None] Created volume successfully.
Sep 25 17:01:56 devstack cinder-volume[86955]: WARNING py.warnings [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 25 17:01:56 devstack cinder-volume[86955]:   .first()
Sep 25 17:01:56 devstack cinder-volume[86955]: 
Sep 25 17:01:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:01:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:01:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:01:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a7a102f-4c35-449f-866b-ce9e0b4f3215', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:01:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8d252564-7e0e-4966-be55-715d309cae92 req-0734ddad-07c7-414f-9204-bdf51e6a0356 tempest-AttachVolumeTestJSON-1056916763 None] attachment_update completed successfully.
Sep 25 17:02:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e6a6eb0-3f58-48bf-9181-887cb71a389f tempest-GroupsV320Test-974198675 None] Group tempest-GroupsV320Test-Group-926570810: creating
Sep 25 17:02:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e6a6eb0-3f58-48bf-9181-887cb71a389f tempest-GroupsV320Test-974198675 None] Group tempest-GroupsV320Test-Group-926570810: created successfully
Sep 25 17:02:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e6a6eb0-3f58-48bf-9181-887cb71a389f tempest-GroupsV320Test-974198675 None] Create group completed successfully.
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Created reservations ['e39b29f8-9733-49c9-be37-084504220a14'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:03 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:02:03 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:03 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:02:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b87ac24-bd5c-4eeb-8ade-8e61f7c0da5c tempest-GroupsV320Test-974198675 None] Delete group completed successfully.
Sep 25 17:02:03 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:02:03 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:03 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:02:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:02:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=46,cinder:UPDATE=50,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:02:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=52,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:02:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Flow 'volume_create_manager' (ec5c52b4-f205-4f96-a197-3e49f40ec046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6303ff15-134c-44a8-8233-894a442d4550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6303ff15-134c-44a8-8233-894a442d4550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1293633679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6c753e-a757-4dd3-ada9-f2c6f4f6845c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f74c5a7e494e9b9ffdccaeb76d5644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:36Z,use_quota=True,user_id='6a727e151810481d9acdea996625b552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5454b6d4-ef18-4970-b586-30373747d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5454b6d4-ef18-4970-b586-30373747d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f712cc-30b2-4b12-8e3f-ec2dfe084157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f712cc-30b2-4b12-8e3f-ec2dfe084157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6c753e-a757-4dd3-ada9-f2c6f4f6845c', 'volume_name': 'volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d16c6d-7172-427e-bb70-ecf3c49743c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d16c6d-7172-427e-bb70-ecf3c49743c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af73d9ee-0e0d-491e-a9ff-1ee7a193d8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Volume 1d6c753e-a757-4dd3-ada9-f2c6f4f6845c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c', 'volume_size': 1}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1293633679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6c753e-a757-4dd3-ada9-f2c6f4f6845c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f74c5a7e494e9b9ffdccaeb76d5644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:36Z,use_quota=True,user_id='6a727e151810481d9acdea996625b552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Creating volume 1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:02:35 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:02:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:35 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c 1073741824
Sep 25 17:02:35 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:36 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c 1073741824" returned: 0 in 0.616s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:36 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c
Sep 25 17:02:36 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:36 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" returned: 0 in 0.411s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af73d9ee-0e0d-491e-a9ff-1ee7a193d8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae355d7-e0ef-404f-87ac-15e58edee6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Volume volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c (1d6c753e-a757-4dd3-ada9-f2c6f4f6845c): created successfully
Sep 25 17:02:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae355d7-e0ef-404f-87ac-15e58edee6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Flow 'volume_create_manager' (ec5c52b4-f205-4f96-a197-3e49f40ec046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-23c97104-f20d-492b-9ce1-3b9d11591797 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Created volume successfully.
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Creating offline snapshot d5f2967e-e3af-4281-b7c8-bd14f062a5d8 of volume 1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a68e36-034c-4162-a3a8-b6188badda2f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:38 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c
Sep 25 17:02:38 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:38 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" returned: 0 in 0.446s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:38 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 1G
Sep 25 17:02:38 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:39 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 1G" returned: 0 in 0.605s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:39 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8
Sep 25 17:02:39 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:39 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8" returned: 0 in 0.486s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 is being set with open permissions: ugo+rw
Sep 25 17:02:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:39 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8
Sep 25 17:02:39 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-13486136-b327-4ce5-8e7c-0082385895dd req-a9ec20b7-118c-42bf-b54f-1a27377b1b12 tempest-AttachVolumeTestJSON-1056916763 None] Terminate volume connection completed successfully.
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-13486136-b327-4ce5-8e7c-0082385895dd req-a9ec20b7-118c-42bf-b54f-1a27377b1b12 tempest-AttachVolumeTestJSON-1056916763 None] Deleting attachment 0a7a102f-4c35-449f-866b-ce9e0b4f3215. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:02:40 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8" returned: 0 in 0.391s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:40 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info
Sep 25 17:02:40 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:40 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info" returned: 0 in 0.313s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:40 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info is being set with open permissions: ugo+rw
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:40 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info
Sep 25 17:02:40 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:40 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.info" returned: 0 in 0.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a8c61640-b237-4c77-975d-b617a647bb3c tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Create snapshot completed successfully
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "cinder-d5f2967e-e3af-4281-b7c8-bd14f062a5d8-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-d5f2967e-e3af-4281-b7c8-bd14f062a5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "cinder-quobyte-d5f2967e-e3af-4281-b7c8-bd14f062a5d8" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-d5f2967e-e3af-4281-b7c8-bd14f062a5d8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Deleting offline snapshot d5f2967e-e3af-4281-b7c8-bd14f062a5d8 of volume 1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] snapshot_file for this snap is: volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c8617-2dfe-403e-b1c9-9a70a71f19b8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:42 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8
Sep 25 17:02:42 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:42 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8" returned: 0 in 0.450s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d38463-8460-4094-b404-7a23c1b47f9e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:02:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:42 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c
Sep 25 17:02:42 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:43 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" returned: 0 in 0.613s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:43 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8
Sep 25 17:02:43 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Flow 'volume_create_manager' (debcf173-97f1-45a7-b0be-15195c565333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768fd307-b3c7-4303-86d6-dab3d4dabc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768fd307-b3c7-4303-86d6-dab3d4dabc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1117285231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a098ec-4f5c-4aea-a814-8ebfdee653a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4904912c9de45f0b9dcbbd9d922bbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:44Z,use_quota=True,user_id='cf638fa263ff4749a7794b0b624e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f5544b-3b31-4170-a330-eeb9306def03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f5544b-3b31-4170-a330-eeb9306def03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1655c68a-edf5-4693-80dd-61041ae81b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1655c68a-edf5-4693-80dd-61041ae81b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a098ec-4f5c-4aea-a814-8ebfdee653a0', 'volume_name': 'volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259b9d6-dbb4-4911-a5c1-76b6a4e03791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259b9d6-dbb4-4911-a5c1-76b6a4e03791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052c357b-6297-4f46-b818-22b8df49c31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Volume 62a098ec-4f5c-4aea-a814-8ebfdee653a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0', 'volume_size': 1}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1117285231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a098ec-4f5c-4aea-a814-8ebfdee653a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4904912c9de45f0b9dcbbd9d922bbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:44Z,use_quota=True,user_id='cf638fa263ff4749a7794b0b624e930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Creating volume 62a098ec-4f5c-4aea-a814-8ebfdee653a0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:43 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:02:43 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8" returned: 0 in 0.625s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:43 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 1073741824
Sep 25 17:02:43 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:43 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8
Sep 25 17:02:43 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:44 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c.d5f2967e-e3af-4281-b7c8-bd14f062a5d8" returned: 0 in 0.437s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-d5f2967e-e3af-4281-b7c8-bd14f062a5d8" released by "_delete_snapshot" :: held 2.341s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" released by "delete_snapshot" :: held 2.375s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:44 devstack cinder-volume[86955]: WARNING cinder.quota [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Created reservations ['bc612789-ebbc-46b2-8f4e-00ec0a7e436a', '5f5b6660-561e-41ed-90fc-413350cdcc91', '656d063c-0c8f-4ea3-b806-d6c8031d2fab', 'b57eed29-1f2a-4f17-84b9-8291856a90f0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:02:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Delete snapshot completed successfully.
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1f80980-df8a-4771-b7d2-752ccd6fa326 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-d5f2967e-e3af-4281-b7c8-bd14f062a5d8-delete_snapshot" released by "delete_snapshot" :: held 2.664s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:44 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 1073741824" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:44 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0
Sep 25 17:02:44 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0" returned: 0 in 0.590s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:45 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052c357b-6297-4f46-b818-22b8df49c31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2778ce25-69b5-4e7d-b036-bc1a49fc557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Volume volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 (62a098ec-4f5c-4aea-a814-8ebfdee653a0): created successfully
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2778ce25-69b5-4e7d-b036-bc1a49fc557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Flow 'volume_create_manager' (debcf173-97f1-45a7-b0be-15195c565333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fd3b7525-b38c-4a7e-96b4-de8cc72e4bde tempest-DeleteServersTestJSON-1337309488 None] Created volume successfully.
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "cinder-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d882b3-092b-4160-97f3-4a6b7dfd133d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:02:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:46 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c
Sep 25 17:02:46 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:46 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" returned: 0 in 0.702s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:46 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c
Sep 25 17:02:46 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:47 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" returned: 0 in 0.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-quobyte-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c" released by "delete_volume" :: held 1.789s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Created reservations ['b4a5476a-2eb4-43d0-998e-9c971ce795ad', '983128e6-7494-4f96-a50e-39fcad852c8c', '239629f6-6a13-4b2c-996e-d7c9083fc236', '6a0ad8a9-c421-464c-be68-1e673a1d9adb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:48 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:02:48 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-237c0d41-ba4f-4969-ae2b-60fca5be0335 req-66309a80-f0fd-4bc1-9a9f-a96e51922d8c tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-237c0d41-ba4f-4969-ae2b-60fca5be0335 req-66309a80-f0fd-4bc1-9a9f-a96e51922d8c tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-237c0d41-ba4f-4969-ae2b-60fca5be0335 req-66309a80-f0fd-4bc1-9a9f-a96e51922d8c tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-237c0d41-ba4f-4969-ae2b-60fca5be0335 req-66309a80-f0fd-4bc1-9a9f-a96e51922d8c tempest-DeleteServersTestJSON-1337309488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a03ff3d3-f600-4fa7-90ee-b801d18e3806', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:02:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-237c0d41-ba4f-4969-ae2b-60fca5be0335 req-66309a80-f0fd-4bc1-9a9f-a96e51922d8c tempest-DeleteServersTestJSON-1337309488 None] attachment_update completed successfully.
Sep 25 17:02:48 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:02:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Deleted volume successfully.
Sep 25 17:02:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63c0f2ec-8799-4b28-a025-11de1c60f050 tempest-VolumeSnapshotQuotasNegativeTestJSON-666753916 None] Lock "cinder-1d6c753e-a757-4dd3-ada9-f2c6f4f6845c-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Flow 'volume_create_manager' (710f8777-7678-4de0-a2b2-0e12eac17ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7da9286-c449-45ec-befd-1d514952e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7da9286-c449-45ec-befd-1d514952e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-898332076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a12882d-786b-4f3a-a9e2-14224ed6ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4799571da0934bbd91728c4a43de21f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:49Z,use_quota=True,user_id='e421098264dc4dcfb0c1362c8ed47054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31b1416-0be1-48c2-b849-393043113147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31b1416-0be1-48c2-b849-393043113147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2177a54-514e-41fb-b62b-fb17869c25c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2177a54-514e-41fb-b62b-fb17869c25c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'volume_name': 'volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb537fb-c437-48ca-974c-28330eea5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb537fb-c437-48ca-974c-28330eea5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e342529-2f80-4cf7-b221-81d3a51d0616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Volume 0a12882d-786b-4f3a-a9e2-14224ed6ee07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'volume_size': 1}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-898332076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a12882d-786b-4f3a-a9e2-14224ed6ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4799571da0934bbd91728c4a43de21f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:49Z,use_quota=True,user_id='e421098264dc4dcfb0c1362c8ed47054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Creating volume 0a12882d-786b-4f3a-a9e2-14224ed6ee07 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:02:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:02:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:49 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 1073741824
Sep 25 17:02:49 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:50 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 1073741824" returned: 0 in 0.824s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:50 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07
Sep 25 17:02:50 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:51 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07" returned: 0 in 0.726s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e342529-2f80-4cf7-b221-81d3a51d0616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0636de-c433-4f49-adfa-9e68253e4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:02:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Volume volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 (0a12882d-786b-4f3a-a9e2-14224ed6ee07): created successfully
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0636de-c433-4f49-adfa-9e68253e4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:02:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Flow 'volume_create_manager' (710f8777-7678-4de0-a2b2-0e12eac17ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:02:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa2473fe-221c-453c-a661-68c1ecebe8a0 tempest-ServerActionsTestOtherA-1511814876 None] Created volume successfully.
Sep 25 17:02:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8938c039-4758-45a8-b480-1d26df0fd5e8 req-e0d62826-4a87-4573-b002-e5ac45b1b180 tempest-DeleteServersTestJSON-1337309488 None] Terminate volume connection completed successfully.
Sep 25 17:02:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8938c039-4758-45a8-b480-1d26df0fd5e8 req-e0d62826-4a87-4573-b002-e5ac45b1b180 tempest-DeleteServersTestJSON-1337309488 None] Deleting attachment a03ff3d3-f600-4fa7-90ee-b801d18e3806. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "cinder-62a098ec-4f5c-4aea-a814-8ebfdee653a0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "cinder-62a098ec-4f5c-4aea-a814-8ebfdee653a0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "cinder-quobyte-62a098ec-4f5c-4aea-a814-8ebfdee653a0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "cinder-quobyte-62a098ec-4f5c-4aea-a814-8ebfdee653a0" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[52948021-1e71-478a-9639-8c9272bfe627]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:02:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:56 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0
Sep 25 17:02:56 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:56 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0" returned: 0 in 0.528s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:56 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0
Sep 25 17:02:56 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:56 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-62a098ec-4f5c-4aea-a814-8ebfdee653a0" returned: 0 in 0.411s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "cinder-quobyte-62a098ec-4f5c-4aea-a814-8ebfdee653a0" released by "delete_volume" :: held 1.012s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Created reservations ['f80f96ce-cdea-41dd-9acb-62644e3abfe5', '808612ec-f111-44c3-b532-e496b9eafaf3', 'efaa767b-ff3e-4f6b-b8b2-2e40ac8f227f', '74b89cd6-d04d-4056-a560-5f39ad2e5090'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:02:57 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:02:57 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:02:57 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:02:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Deleted volume successfully.
Sep 25 17:02:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6934be84-ea27-4368-a0a8-f64e208dfa25 tempest-DeleteServersTestJSON-1337309488 None] Lock "cinder-62a098ec-4f5c-4aea-a814-8ebfdee653a0-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:03 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:03:03 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:04 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.479s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:03:07 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=35,cinder:SELECT=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:03:07 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=33,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Flow 'volume_create_manager' (a2ccb4a3-6eb3-4a73-9378-a5498650bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb86369-4d60-4d35-88e1-b17daa966e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb86369-4d60-4d35-88e1-b17daa966e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1163144831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50aeb58-acc8-4b34-9a3d-26b921e8557f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae5a3af4a3f4591a30fe4d0b99227b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:09Z,use_quota=True,user_id='b2697bc24524402d93e9b2207ed74890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aee216-991c-40d5-8322-43daa3ce175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1aee216-991c-40d5-8322-43daa3ce175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0f89bd-7666-443d-bbe3-81f723000929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:09 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:03:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0f89bd-7666-443d-bbe3-81f723000929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e50aeb58-acc8-4b34-9a3d-26b921e8557f', 'volume_name': 'volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48adae840>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466cb264-16a5-4700-865f-459cc4e815a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466cb264-16a5-4700-865f-459cc4e815a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675043b2-bf7f-4413-ad0b-a88dab2cf6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Volume e50aeb58-acc8-4b34-9a3d-26b921e8557f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48adae840>}
Sep 25 17:03:10 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Trying to clone e50aeb58-acc8-4b34-9a3d-26b921e8557f from image 21fcf20c-2aec-48a7-986a-08b11deee77e at location (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:03:11 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:03:11 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 17:03:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22cd61-9d46-4c01-bbf2-883733872172]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:11 devstack sudo[90476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD
Sep 25 17:03:11 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:11 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:11 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e is fetched for user b2697bc24524402d93e9b2207ed74890. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff71a2-d92e-4c42-8abd-fee4aa1870ac]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:12 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD
Sep 25 17:03:12 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:12 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1163144831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50aeb58-acc8-4b34-9a3d-26b921e8557f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae5a3af4a3f4591a30fe4d0b99227b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:09Z,use_quota=True,user_id='b2697bc24524402d93e9b2207ed74890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Creating volume e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:03:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:03:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:12 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1073741824
Sep 25 17:03:12 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:13 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1073741824" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:13 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f
Sep 25 17:03:13 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:13 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f" returned: 0 in 0.358s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Attempting download of 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume e50aeb58-acc8-4b34-9a3d-26b921e8557f. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd41079a-46f6-4cef-85fc-b91754daafba]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:14 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t
Sep 25 17:03:14 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:14 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t" returned: 0 in 0.497s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:14 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t
Sep 25 17:03:14 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:14 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t" returned: 1 in 0.340s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_upprbk7t' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb1bea-7725-4763-b1b1-50fab6f5ceb8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:14 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD
Sep 25 17:03:14 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:15 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:15 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] 21fcf20c-2aec-48a7-986a-08b11deee77e was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:03:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:15 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f
Sep 25 17:03:15 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:18 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f" returned: 0 in 2.888s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_1cntb3i4devstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:03:18 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Converted 112.00 MB image at 38.76 MB/s
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:18 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1G
Sep 25 17:03:18 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:18 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f 1G" returned: 0 in 0.444s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Downloaded image 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume e50aeb58-acc8-4b34-9a3d-26b921e8557f successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e for user b2697bc24524402d93e9b2207ed74890 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Marking volume e50aeb58-acc8-4b34-9a3d-26b921e8557f as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Copying metadata from image 21fcf20c-2aec-48a7-986a-08b11deee77e to e50aeb58-acc8-4b34-9a3d-26b921e8557f. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Creating volume glance metadata for volume e50aeb58-acc8-4b34-9a3d-26b921e8557f backed by image 21fcf20c-2aec-48a7-986a-08b11deee77e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675043b2-bf7f-4413-ad0b-a88dab2cf6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48adae840>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a282c74-4d33-4542-8d35-41b263cc7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Volume volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f (e50aeb58-acc8-4b34-9a3d-26b921e8557f): created successfully
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a282c74-4d33-4542-8d35-41b263cc7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Flow 'volume_create_manager' (a2ccb4a3-6eb3-4a73-9378-a5498650bd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a504c21e-02f9-408c-8c1d-5077876c5dfe tempest-VolumesImageMetadata-924471777 None] Created volume successfully.
Sep 25 17:03:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Acquiring lock "cinder-e50aeb58-acc8-4b34-9a3d-26b921e8557f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "cinder-e50aeb58-acc8-4b34-9a3d-26b921e8557f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Acquiring lock "cinder-quobyte-e50aeb58-acc8-4b34-9a3d-26b921e8557f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "cinder-quobyte-e50aeb58-acc8-4b34-9a3d-26b921e8557f" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f4b46-14da-4605-83dc-e9c900bfc5aa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:20 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f
Sep 25 17:03:20 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:20 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f" returned: 0 in 0.436s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:20 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f
Sep 25 17:03:20 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:20 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e50aeb58-acc8-4b34-9a3d-26b921e8557f" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "cinder-quobyte-e50aeb58-acc8-4b34-9a3d-26b921e8557f" released by "delete_volume" :: held 0.768s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Created reservations ['b7c69853-ccbd-44ef-bdbc-fad29e91a6a9', '247fa054-ac19-4019-874e-ccfe133f0cf5', '2fceda61-276b-47bf-9cc9-633a43eb6c48', 'd31d2d15-36d0-42d4-8d74-9edc4286bad9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:21 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:03:21 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:21 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.485s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:03:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Deleted volume successfully.
Sep 25 17:03:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6318ffbd-f70c-4a88-8297-9d816ef9d6ea tempest-VolumesImageMetadata-924471777 None] Lock "cinder-e50aeb58-acc8-4b34-9a3d-26b921e8557f-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Flow 'volume_create_manager' (5c343fe3-dac3-4617-926d-dddc66e2d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd377a-7092-4be3-bd69-c9f4e0b0d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dd377a-7092-4be3-bd69-c9f4e0b0d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-766699541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc0ec56-17e4-46b9-9b34-13493537d271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f3767ba7046a680eabe2a5e5ed7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:27Z,use_quota=True,user_id='0b113864a56e4806b3cee8eec70de8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a85553-0dd5-4e7f-a925-c2f83c168b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a85553-0dd5-4e7f-a925-c2f83c168b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139571ea-b27f-4817-8e80-99b1b21793e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139571ea-b27f-4817-8e80-99b1b21793e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc0ec56-17e4-46b9-9b34-13493537d271', 'volume_name': 'volume-ddc0ec56-17e4-46b9-9b34-13493537d271', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9971b6a3-0a7a-4e6c-8ec5-169ad7cf3e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9971b6a3-0a7a-4e6c-8ec5-169ad7cf3e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5f0dde-ad2b-47a9-a973-5bff123ccc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Volume ddc0ec56-17e4-46b9-9b34-13493537d271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc0ec56-17e4-46b9-9b34-13493537d271', 'volume_size': 1}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-766699541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc0ec56-17e4-46b9-9b34-13493537d271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f3767ba7046a680eabe2a5e5ed7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:27Z,use_quota=True,user_id='0b113864a56e4806b3cee8eec70de8cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Creating volume ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:03:26 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:03:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:26 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 1073741824
Sep 25 17:03:26 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:27 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 1073741824" returned: 0 in 0.832s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:27 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271
Sep 25 17:03:27 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:28 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271" returned: 0 in 0.286s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5f0dde-ad2b-47a9-a973-5bff123ccc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc0ec56-17e4-46b9-9b34-13493537d271', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0566cf30-7fce-4818-84b8-efcb530f77e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Volume volume-ddc0ec56-17e4-46b9-9b34-13493537d271 (ddc0ec56-17e4-46b9-9b34-13493537d271): created successfully
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0566cf30-7fce-4818-84b8-efcb530f77e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Flow 'volume_create_manager' (5c343fe3-dac3-4617-926d-dddc66e2d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d7c4aed4-29e7-4224-8902-144ec411aefd tempest-SnapshotMetadataTestJSON-2131911589 None] Created volume successfully.
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Creating offline snapshot a132c0ee-b692-4cce-af04-6bdd54129d81 of volume ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9820f-4d72-4f4c-8d43-80d43ef3ac57]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:29 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271
Sep 25 17:03:29 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:29 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271" returned: 0 in 0.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:29 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 1G
Sep 25 17:03:29 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:30 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 1G" returned: 0 in 0.828s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc0ec56-17e4-46b9-9b34-13493537d271 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:30 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc0ec56-17e4-46b9-9b34-13493537d271 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81
Sep 25 17:03:30 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d842b0c2-ee32-49b9-81ce-4c22da61aa57 req-4f00d318-401c-4d2e-9d7c-9b7e40380227 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:31 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc0ec56-17e4-46b9-9b34-13493537d271 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81" returned: 0 in 0.462s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 is being set with open permissions: ugo+rw
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:31 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81
Sep 25 17:03:31 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:31 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81" returned: 0 in 0.335s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:31 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info
Sep 25 17:03:31 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:31 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info" returned: 0 in 0.415s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info is being set with open permissions: ugo+rw
Sep 25 17:03:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:31 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info
Sep 25 17:03:31 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:32 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.info" returned: 0 in 0.423s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.256s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d842b0c2-ee32-49b9-81ce-4c22da61aa57 req-4f00d318-401c-4d2e-9d7c-9b7e40380227 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.559s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d842b0c2-ee32-49b9-81ce-4c22da61aa57 req-4f00d318-401c-4d2e-9d7c-9b7e40380227 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0beaf606-0e18-4b34-9f8e-b59822fbd1ea tempest-SnapshotMetadataTestJSON-2131911589 None] Create snapshot completed successfully
Sep 25 17:03:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-d842b0c2-ee32-49b9-81ce-4c22da61aa57 req-4f00d318-401c-4d2e-9d7c-9b7e40380227 tempest-ServerActionsTestOtherA-1511814876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f96bd0e-9414-44ba-84ca-e4a019a6a7e0', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:03:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-d842b0c2-ee32-49b9-81ce-4c22da61aa57 req-4f00d318-401c-4d2e-9d7c-9b7e40380227 tempest-ServerActionsTestOtherA-1511814876 None] attachment_update completed successfully.
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "cinder-a132c0ee-b692-4cce-af04-6bdd54129d81-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-a132c0ee-b692-4cce-af04-6bdd54129d81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "cinder-quobyte-a132c0ee-b692-4cce-af04-6bdd54129d81" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-a132c0ee-b692-4cce-af04-6bdd54129d81" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Deleting offline snapshot a132c0ee-b692-4cce-af04-6bdd54129d81 of volume ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] snapshot_file for this snap is: volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[872cca4b-20de-4ca7-82b8-951febdd7173]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:35 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81
Sep 25 17:03:35 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:35 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81" returned: 0 in 0.689s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc0ec56-17e4-46b9-9b34-13493537d271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:03:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b98f82-df79-4528-9909-74bd54d69579]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:35 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271
Sep 25 17:03:35 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:36 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271" returned: 0 in 0.575s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:36 devstack sudo[91221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81
Sep 25 17:03:36 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:36 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81" returned: 0 in 0.738s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:37 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81
Sep 25 17:03:37 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:37 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271.a132c0ee-b692-4cce-af04-6bdd54129d81" returned: 0 in 0.610s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-a132c0ee-b692-4cce-af04-6bdd54129d81" released by "_delete_snapshot" :: held 2.866s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" released by "delete_snapshot" :: held 2.908s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Created reservations ['20f25f8d-22c8-42fa-a4ed-794f3dd2f6a6', 'ac277d24-85cb-4dd2-bcf3-a9465f618dbc', '9276d680-3ac6-4cde-8d0f-a35178b15bf6', 'b1974a92-a97a-4bfd-b288-b5643c8b4df6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:03:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Delete snapshot completed successfully.
Sep 25 17:03:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ee471a0e-095e-46cd-8e8d-034ff04977de tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-a132c0ee-b692-4cce-af04-6bdd54129d81-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "cinder-ddc0ec56-17e4-46b9-9b34-13493537d271-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-ddc0ec56-17e4-46b9-9b34-13493537d271-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f21a024-587a-4ed5-97c2-5746c6905445]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:38 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271
Sep 25 17:03:38 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-da7f9cbf-ddac-4b4c-8da4-825347aaf94b tempest-ServerActionsTestOtherA-1511814876 None] Terminate volume connection completed successfully.
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-da7f9cbf-ddac-4b4c-8da4-825347aaf94b tempest-ServerActionsTestOtherA-1511814876 None] Deleting attachment 3f96bd0e-9414-44ba-84ca-e4a019a6a7e0. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:03:39 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271" returned: 0 in 0.588s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:39 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271
Sep 25 17:03:39 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:39 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ddc0ec56-17e4-46b9-9b34-13493537d271" returned: 0 in 0.548s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-quobyte-ddc0ec56-17e4-46b9-9b34-13493537d271" released by "delete_volume" :: held 1.259s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Created reservations ['4368bfa9-2307-4980-b9bb-be01f264e490', 'fc87db74-9aec-4be0-a0ef-68a5fa69ebe7', 'd263724f-fa23-4d55-a439-94eff118aa26', 'c443a660-c3af-4ff5-9ab9-a8538617a911'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:39 devstack sudo[91303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:03:39 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-fa70390d-828b-4991-84f8-6c3ee608ace4 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-fa70390d-828b-4991-84f8-6c3ee608ace4 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-fa70390d-828b-4991-84f8-6c3ee608ace4 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:40 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.433s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-fa70390d-828b-4991-84f8-6c3ee608ace4 tempest-ServerActionsTestOtherA-1511814876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faf87407-9df8-4bc9-9a80-c26bc8d911da', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:03:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Deleted volume successfully.
Sep 25 17:03:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b1e93c1-c9ff-4ae9-a370-48fbc5de025a tempest-SnapshotMetadataTestJSON-2131911589 None] Lock "cinder-ddc0ec56-17e4-46b9-9b34-13493537d271-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-50fddd49-52dd-4d97-820b-0867378c07b5 req-fa70390d-828b-4991-84f8-6c3ee608ace4 tempest-ServerActionsTestOtherA-1511814876 None] attachment_update completed successfully.
Sep 25 17:03:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Flow 'volume_create_manager' (4d994f65-9b72-4c3d-9d37-ba3af93c9bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cc2257-c4d3-457e-8fe8-f6efa8c52616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cc2257-c4d3-457e-8fe8-f6efa8c52616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1790105320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ee184d-27f2-47fa-a985-e7fb82919d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e9880d29fa4272acd4c2aa33df1b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:45Z,use_quota=True,user_id='1847fc2c7c80434e9ef95421908044ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45933bf5-0cdc-4398-96e4-1e6c3ae8a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45933bf5-0cdc-4398-96e4-1e6c3ae8a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93d19f3-8d72-423a-8684-99c0604a700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93d19f3-8d72-423a-8684-99c0604a700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ee184d-27f2-47fa-a985-e7fb82919d53', 'volume_name': 'volume-21ee184d-27f2-47fa-a985-e7fb82919d53', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998434ad-3d41-481e-9f37-c5235b055819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998434ad-3d41-481e-9f37-c5235b055819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3762457-4b3d-4cb4-8819-3cc5044307ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Volume 21ee184d-27f2-47fa-a985-e7fb82919d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ee184d-27f2-47fa-a985-e7fb82919d53', 'volume_size': 1}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1790105320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ee184d-27f2-47fa-a985-e7fb82919d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e9880d29fa4272acd4c2aa33df1b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:45Z,use_quota=True,user_id='1847fc2c7c80434e9ef95421908044ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Creating volume 21ee184d-27f2-47fa-a985-e7fb82919d53 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:03:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:03:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:45 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 1073741824
Sep 25 17:03:45 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:46 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 1073741824" returned: 0 in 0.903s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:46 devstack sudo[91819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53
Sep 25 17:03:46 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:46 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53" returned: 0 in 0.337s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3762457-4b3d-4cb4-8819-3cc5044307ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ee184d-27f2-47fa-a985-e7fb82919d53', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440ed7d9-1d56-43c3-b800-27c14ad57d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Volume volume-21ee184d-27f2-47fa-a985-e7fb82919d53 (21ee184d-27f2-47fa-a985-e7fb82919d53): created successfully
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440ed7d9-1d56-43c3-b800-27c14ad57d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Flow 'volume_create_manager' (4d994f65-9b72-4c3d-9d37-ba3af93c9bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bb11c66a-75fe-4597-a68c-e49a102c918e tempest-TaggedAttachmentsTest-1081787216 None] Created volume successfully.
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (0d4531c3-aae1-479b-ae6e-8e1f94b89ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ae0f5-22a2-40ea-87e8-6de2eac1ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ae0f5-22a2-40ea-87e8-6de2eac1ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-556178798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7a237d440461aa86b4504db5e1b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:47Z,use_quota=True,user_id='fc649c3ef7e542dc85a51aef5d2074af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fb2721-63a8-4424-8995-8834180a3783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fb2721-63a8-4424-8995-8834180a3783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe293979-0b79-43cf-9bf0-7da1af48f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe293979-0b79-43cf-9bf0-7da1af48f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9', 'volume_name': 'volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89fb92-8897-4d38-8a4c-9ee57e3263c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89fb92-8897-4d38-8a4c-9ee57e3263c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a2de1-3559-41df-b975-a75fc9fa9787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9', 'volume_size': 1}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-556178798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7a237d440461aa86b4504db5e1b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:47Z,use_quota=True,user_id='fc649c3ef7e542dc85a51aef5d2074af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Creating volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:03:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:47 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 1073741824
Sep 25 17:03:47 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:47 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 1073741824" returned: 0 in 0.564s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:47 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9
Sep 25 17:03:47 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:48 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a2de1-3559-41df-b975-a75fc9fa9787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf603219-508f-48c1-870f-0d0e4259da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Volume volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 (ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9): created successfully
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf603219-508f-48c1-870f-0d0e4259da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (0d4531c3-aae1-479b-ae6e-8e1f94b89ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ff3ae242-b434-4a83-864f-b6932637ae54 tempest-VolumesDeleteCascade-940433656 None] Created volume successfully.
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Creating offline snapshot e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d of volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4fa34a-f74b-48f8-ae64-ccf83249ede9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:49 devstack sudo[91832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9
Sep 25 17:03:49 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:49 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" returned: 0 in 0.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:49 devstack sudo[91837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d 1G
Sep 25 17:03:49 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:50 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d 1G" returned: 0 in 0.523s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:50 devstack sudo[91844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:03:50 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:50 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.391s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d is being set with open permissions: ugo+rw
Sep 25 17:03:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:50 devstack sudo[91849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:03:50 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:51 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.342s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:51 devstack sudo[91855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info
Sep 25 17:03:51 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:51 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info" returned: 0 in 0.320s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:51 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info is being set with open permissions: ugo+rw
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:51 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info
Sep 25 17:03:51 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:51 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.info" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9f190818-b1a7-4d10-b8c5-c1fc00373be3 tempest-VolumesDeleteCascade-940433656 None] Create snapshot completed successfully
Sep 25 17:03:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Creating offline snapshot 753c2c9b-4326-4ab9-9749-2e2362a19f1b of volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f765aa-4c44-4f99-a72c-227d71731913]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:53 devstack sudo[91869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:03:53 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (c23ceee0-f9e3-4b8e-99be-a0c15b23251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de451bc-c459-4ded-b683-cd18f2c149e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de451bc-c459-4ded-b683-cd18f2c149e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1645055773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba457b4-8fd2-42cf-9145-455063001867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:54Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592efa8e-2e6b-4dc9-9092-c7423ded6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592efa8e-2e6b-4dc9-9092-c7423ded6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba93b5c-a220-4c78-ae16-0d0457137ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba93b5c-a220-4c78-ae16-0d0457137ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba457b4-8fd2-42cf-9145-455063001867', 'volume_name': 'volume-1ba457b4-8fd2-42cf-9145-455063001867', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f6a361-0b3e-4b14-ac8f-93d0384796a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f6a361-0b3e-4b14-ac8f-93d0384796a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d43ae92-bef4-4c3a-bdce-9b2a52f909a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Volume 1ba457b4-8fd2-42cf-9145-455063001867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba457b4-8fd2-42cf-9145-455063001867', 'volume_size': 1}
Sep 25 17:03:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:54 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.948s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:54 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b 1G
Sep 25 17:03:54 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:54 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b 1G" returned: 0 in 0.537s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:54 devstack sudo[91893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b
Sep 25 17:03:54 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:54 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b" returned: 0 in 0.381s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b is being set with open permissions: ugo+rw
Sep 25 17:03:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:54 devstack sudo[91898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b
Sep 25 17:03:54 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:55 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b" returned: 0 in 0.335s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1645055773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba457b4-8fd2-42cf-9145-455063001867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:54Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Creating volume 1ba457b4-8fd2-42cf-9145-455063001867 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:03:55 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:55 devstack sudo[91902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 1073741824
Sep 25 17:03:55 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5ad7164f-0861-4333-bf20-a94ccba260a4 tempest-VolumesDeleteCascade-940433656 None] Create snapshot completed successfully
Sep 25 17:03:55 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 1073741824" returned: 0 in 0.589s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:56 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867
Sep 25 17:03:56 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Performing cascade delete. {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-753c2c9b-4326-4ab9-9749-2e2362a19f1b-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:56 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-753c2c9b-4326-4ab9-9749-2e2362a19f1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d43ae92-bef4-4c3a-bdce-9b2a52f909a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba457b4-8fd2-42cf-9145-455063001867', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219f6b48-1dd7-4705-8e17-b93f581c2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" acquired by "delete_snapshot" :: waited 0.095s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-753c2c9b-4326-4ab9-9749-2e2362a19f1b" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:56 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Volume volume-1ba457b4-8fd2-42cf-9145-455063001867 (1ba457b4-8fd2-42cf-9145-455063001867): created successfully
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219f6b48-1dd7-4705-8e17-b93f581c2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (c23ceee0-f9e3-4b8e-99be-a0c15b23251e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-753c2c9b-4326-4ab9-9749-2e2362a19f1b" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Deleting offline snapshot 753c2c9b-4326-4ab9-9749-2e2362a19f1b of volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:03:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] snapshot_file for this snap is: volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:03:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0944ffba-6a92-49ea-b53b-0d9bc44ff023 tempest-AttachVolumeTestJSON-1056916763 None] Created volume successfully.
Sep 25 17:03:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b6670-2d09-4aab-abc7-747d20118b09]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:57 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b
Sep 25 17:03:57 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:57 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b" returned: 0 in 0.872s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:03:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53be355-e31a-44d7-9524-7eabeb5f45cf]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:03:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:58 devstack sudo[91981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:03:58 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:58 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.572s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:03:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:58 devstack sudo[92033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b
Sep 25 17:03:58 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:59 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b" returned: 0 in 0.641s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:03:59 devstack sudo[92047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b
Sep 25 17:03:59 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10933986-3e45-4f80-af16-ed5e1589b0cd req-97623321-14bc-45b8-9a15-6ae9aa734028 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10933986-3e45-4f80-af16-ed5e1589b0cd req-97623321-14bc-45b8-9a15-6ae9aa734028 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10933986-3e45-4f80-af16-ed5e1589b0cd req-97623321-14bc-45b8-9a15-6ae9aa734028 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-10933986-3e45-4f80-af16-ed5e1589b0cd req-97623321-14bc-45b8-9a15-6ae9aa734028 tempest-AttachVolumeTestJSON-1056916763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-1ba457b4-8fd2-42cf-9145-455063001867', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2704ea5b-9945-43ba-ad3e-15538622161e', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:03:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-10933986-3e45-4f80-af16-ed5e1589b0cd req-97623321-14bc-45b8-9a15-6ae9aa734028 tempest-AttachVolumeTestJSON-1056916763 None] attachment_update completed successfully.
Sep 25 17:03:59 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.753c2c9b-4326-4ab9-9749-2e2362a19f1b" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-753c2c9b-4326-4ab9-9749-2e2362a19f1b" released by "_delete_snapshot" :: held 2.606s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" released by "delete_snapshot" :: held 2.690s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Created reservations ['b4c340e1-d16c-4d2a-b56d-f7dc67477610', 'ef97189a-1654-4b60-84d2-3bf8133f7e20', 'fa78c632-468c-4209-81fe-0ffa5f7135c0', '37abc689-8f42-439b-83f6-cab1a983a77d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:03:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Delete snapshot completed successfully.
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-753c2c9b-4326-4ab9-9749-2e2362a19f1b-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:03:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Deleting offline snapshot e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d of volume ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] snapshot_file for this snap is: volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda798cf-fc41-4663-bc1e-d8ded435d102]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:00 devstack sudo[92059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:04:00 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:00 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.520s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[287757a0-634b-425a-b43f-55780476caf8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:00 devstack sudo[92066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9
Sep 25 17:04:00 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:01 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:01 devstack sudo[92071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:04:01 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:01 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.459s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:01 devstack sudo[92076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d
Sep 25 17:04:01 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:01 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9.e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d" released by "_delete_snapshot" :: held 2.055s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" released by "delete_snapshot" :: held 2.113s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Created reservations ['ebbb7b1a-c6b4-4a6f-aec0-300af63a19bb', 'fe0d8864-e0ac-44a8-81a4-4ca182735a09', '892e81fe-b06e-4892-857e-527c48ed1d50', 'a95869f6-c9df-4b1f-b980-7644bc118f76'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (8eb83fec-2a29-4b9a-80e1-59dc751ddd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1580da19-07e4-4580-aff4-952cf6a71570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1580da19-07e4-4580-aff4-952cf6a71570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1450794725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:02Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f38ee66-bf4c-46c0-bf66-77936eeae0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f38ee66-bf4c-46c0-bf66-77936eeae0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92c952a-b0ff-40ce-84da-c39c8ec0db3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92c952a-b0ff-40ce-84da-c39c8ec0db3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c', 'volume_name': 'volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a4d43-2020-49d5-bde5-3b9088edf778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a4d43-2020-49d5-bde5-3b9088edf778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314cbe1f-40e3-400f-81e4-d3f1560d67b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Volume 6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c', 'volume_size': 1}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1450794725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcc707174054167b1dd2fbc58af34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:02Z,use_quota=True,user_id='13ea49daf8f14dd28ce56de087044175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Creating volume 6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:02 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Delete snapshot completed successfully.
Sep 25 17:04:02 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c 1073741824
Sep 25 17:04:02 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-e06e4ed3-9d4c-4478-bed0-d9c3e2d1037d-delete_snapshot" released by "delete_snapshot" :: held 2.509s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Snapshots deleted, issuing volume delete {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6a42d-91f1-4c21-99b5-507dd496d0a8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:02 devstack sudo[92105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9
Sep 25 17:04:02 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:02 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c 1073741824" returned: 0 in 0.638s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:02 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" returned: 0 in 0.522s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:03 devstack sudo[92114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9
Sep 25 17:04:03 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:03 devstack sudo[92116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c
Sep 25 17:04:03 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:03 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:03 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" returned: 0 in 0.358s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9" released by "delete_volume" :: held 1.031s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314cbe1f-40e3-400f-81e4-d3f1560d67b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0094f8c-394c-4f81-b7d0-67805b754ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Volume volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c (6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c): created successfully
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0094f8c-394c-4f81-b7d0-67805b754ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Flow 'volume_create_manager' (8eb83fec-2a29-4b9a-80e1-59dc751ddd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a139b121-1560-42fb-b8b9-84b171e34b50 tempest-AttachVolumeTestJSON-1056916763 None] Created volume successfully.
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:03 devstack sudo[92121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:03 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Created reservations ['184f38b9-f266-46a3-946b-14db2105df80', '4fb19725-d641-4d84-ba4b-a1c81bc255c7', 'd4c9ffad-814a-4427-b95b-65e643ebb5fc', 'a0cce6e9-faae-4f8e-ab68-58905fba7b18'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:03 devstack sudo[92124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:03 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:03 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.304s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:04:03 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.276s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Deleted volume successfully.
Sep 25 17:04:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32d622ec-923d-4e87-a681-8e80088e200e tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-ee005ad6-27b7-4bcc-b45e-8c5fd16fa2e9-delete_volume" released by "delete_volume" :: held 7.385s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8ab31091-c02f-42e4-bc44-067cdb2f683e req-23a933c8-f074-42c5-9f34-f14e70e048fd tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8ab31091-c02f-42e4-bc44-067cdb2f683e req-23a933c8-f074-42c5-9f34-f14e70e048fd tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-8ab31091-c02f-42e4-bc44-067cdb2f683e req-23a933c8-f074-42c5-9f34-f14e70e048fd tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8ab31091-c02f-42e4-bc44-067cdb2f683e req-23a933c8-f074-42c5-9f34-f14e70e048fd tempest-AttachVolumeTestJSON-1056916763 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fad6f780-a90f-4e9f-a937-886b537d4134', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:04:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8ab31091-c02f-42e4-bc44-067cdb2f683e req-23a933c8-f074-42c5-9f34-f14e70e048fd tempest-AttachVolumeTestJSON-1056916763 None] attachment_update completed successfully.
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (ca0a43b8-5621-4d7c-8739-6f91b35ea530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f10ef7-f3e6-42da-a528-5eeb215cf89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f10ef7-f3e6-42da-a528-5eeb215cf89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-543808432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ba99de-434e-463f-9a51-93e50ec5ddf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7a237d440461aa86b4504db5e1b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:05Z,use_quota=True,user_id='fc649c3ef7e542dc85a51aef5d2074af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ee4c2f-7744-4aae-af58-7dde8fbd0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ee4c2f-7744-4aae-af58-7dde8fbd0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dee1b0-8a13-4d4a-ad48-f43c40142740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dee1b0-8a13-4d4a-ad48-f43c40142740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ba99de-434e-463f-9a51-93e50ec5ddf0', 'volume_name': 'volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d74f8a-5c83-47a4-ac94-f50a4d77d6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d74f8a-5c83-47a4-ac94-f50a4d77d6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc7720c-321f-488e-8b9e-e0afbd1f25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Volume a0ba99de-434e-463f-9a51-93e50ec5ddf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0', 'volume_size': 1}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-543808432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ba99de-434e-463f-9a51-93e50ec5ddf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7a237d440461aa86b4504db5e1b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:05Z,use_quota=True,user_id='fc649c3ef7e542dc85a51aef5d2074af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Creating volume a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:05 devstack sudo[92147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 1073741824
Sep 25 17:04:05 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:06 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 1073741824" returned: 0 in 0.561s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:06 devstack sudo[92153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:06 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:06 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc7720c-321f-488e-8b9e-e0afbd1f25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db1d1ea-3c28-4d11-abc7-3eb1bb537ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Volume volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 (a0ba99de-434e-463f-9a51-93e50ec5ddf0): created successfully
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db1d1ea-3c28-4d11-abc7-3eb1bb537ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (ca0a43b8-5621-4d7c-8739-6f91b35ea530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-013e1a25-2bd4-4585-a140-8fcf04d58d5e tempest-VolumesDeleteCascade-940433656 None] Created volume successfully.
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=73,cinder:SELECT=88,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=91,cinder:UPDATE=74,cinder:INSERT=14,cinder:DELETE=7 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Creating offline snapshot f2381957-d26c-4502-93e8-4685710d10b4 of volume a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1331690d-2a1c-447d-a171-e206c92e101f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:08 devstack sudo[92162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:08 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f9936c91-e5dd-4110-b068-61d245b87802 req-8eae8fdd-eb20-492c-a6d7-c87fb2824fee tempest-AttachVolumeTestJSON-1056916763 None] Terminate volume connection completed successfully.
Sep 25 17:04:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f9936c91-e5dd-4110-b068-61d245b87802 req-8eae8fdd-eb20-492c-a6d7-c87fb2824fee tempest-AttachVolumeTestJSON-1056916763 None] Deleting attachment 2704ea5b-9945-43ba-ad3e-15538622161e. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:04:08 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.472s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:08 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 1G
Sep 25 17:04:08 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:08 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 1G" returned: 0 in 0.537s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:08 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:08 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:09 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:09 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 is being set with open permissions: ugo+rw
Sep 25 17:04:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:09 devstack sudo[92184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:09 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:09 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:09 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info
Sep 25 17:04:09 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-67df127b-f3aa-4860-9331-65cbb816af38 req-47553cd4-9c77-4fd6-b4be-d11b297a0db5 tempest-AttachVolumeTestJSON-1056916763 None] Terminate volume connection completed successfully.
Sep 25 17:04:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-67df127b-f3aa-4860-9331-65cbb816af38 req-47553cd4-9c77-4fd6-b4be-d11b297a0db5 tempest-AttachVolumeTestJSON-1056916763 None] Deleting attachment fad6f780-a90f-4e9f-a937-886b537d4134. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:04:10 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:10 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info is being set with open permissions: ugo+rw
Sep 25 17:04:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:10 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info
Sep 25 17:04:10 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:10 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.info" returned: 0 in 0.386s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cb4bc60a-b62f-42f6-ab94-fddb1d576d4e tempest-VolumesDeleteCascade-940433656 None] Create snapshot completed successfully
Sep 25 17:04:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-d7a9cb60-36d4-48a6-a9f0-ff9e9133798a req-20fa24b1-1b03-4859-a4a0-f28dba547c96 tempest-ServerActionsTestOtherA-1511814876 None] Terminate volume connection completed successfully.
Sep 25 17:04:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-d7a9cb60-36d4-48a6-a9f0-ff9e9133798a req-20fa24b1-1b03-4859-a4a0-f28dba547c96 tempest-ServerActionsTestOtherA-1511814876 None] Deleting attachment faf87407-9df8-4bc9-9a80-c26bc8d911da. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (2c23feef-9db6-4a1f-97c6-c04764548015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae86cd8c-4028-421e-b453-66eeae6409ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae86cd8c-4028-421e-b453-66eeae6409ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-200176844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd7a237d440461aa86b4504db5e1b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2381957-d26c-4502-93e8-4685710d10b4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:12Z,use_quota=True,user_id='fc649c3ef7e542dc85a51aef5d2074af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b59217-a07f-46ec-94e1-b0651bba887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b59217-a07f-46ec-94e1-b0651bba887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e242ce-872f-499b-8337-833e93ec71a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e242ce-872f-499b-8337-833e93ec71a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d', 'volume_name': 'volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d', 'volume_size': 1, 'snapshot_id': 'f2381957-d26c-4502-93e8-4685710d10b4'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3964154-9281-4ee5-9ddb-7b705fe5e835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3964154-9281-4ee5-9ddb-7b705fe5e835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d560a7-028d-4a2f-81e2-96dff35784f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Volume 51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d', 'volume_size': 1, 'snapshot_id': 'f2381957-d26c-4502-93e8-4685710d10b4'}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Creating volume 51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d from snapshot f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] snapshot: f2381957-d26c-4502-93e8-4685710d10b4, volume: 51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac02517-d31e-4371-94c3-b75124ce5910]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:13 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:13 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:13 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:04:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1043b43-54c6-4e50-910e-2d9ff2954d1a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:13 devstack sudo[92304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:13 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:14 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.657s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:04:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:04:14 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:04:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:14 devstack sudo[92313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d
Sep 25 17:04:14 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-quobyte-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc0dd3-46a0-4ca3-9901-d98252995939]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:18 devstack sudo[92332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c
Sep 25 17:04:18 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:18 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" returned: 0 in 0.593s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:18 devstack sudo[92337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c
Sep 25 17:04:18 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:18 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" returned: 0 in 0.378s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c" released by "delete_volume" :: held 1.077s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Created reservations ['fe7b5289-4273-4b33-8274-e079848fe55e', 'aec94815-2816-4b33-b3fd-236feeae7d7e', '74efe662-57d9-4ff0-b431-c090f30052e2', '0d74065b-4009-4d0e-84dc-0af836725977'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:19 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:19 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:19 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.639s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Deleted volume successfully.
Sep 25 17:04:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-33a89fa4-fcfe-40ef-93ac-fb9b76f5d283 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-6fc5ff4a-3e84-4cdf-a52a-dcf833a73e3c-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-1ba457b4-8fd2-42cf-9145-455063001867-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-1ba457b4-8fd2-42cf-9145-455063001867-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-quobyte-1ba457b4-8fd2-42cf-9145-455063001867" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-1ba457b4-8fd2-42cf-9145-455063001867" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc69e7-6bbb-4514-b24a-95626d87ff3e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:20 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867
Sep 25 17:04:20 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:21 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867" returned: 0 in 0.766s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:21 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867
Sep 25 17:04:21 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:21 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1ba457b4-8fd2-42cf-9145-455063001867" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-1ba457b4-8fd2-42cf-9145-455063001867" released by "delete_volume" :: held 1.562s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Created reservations ['cb94d7e2-1c5a-437f-a538-502fbb8081b0', '8f9c92d1-9b49-49f2-9fb1-a145bafbc282', 'af9469fe-1b54-4c7e-bcb3-0af40243fdf5', 'ab64d487-3bd2-4c3f-9483-05cb268f376a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:22 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:22 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:22 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" returned: 0 in 8.374s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0, size 1024.00 MB, duration 8.37 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:04:22 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Converted 1024.00 MB image at 122.27 MB/s
Sep 25 17:04:22 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d is being set with open permissions: ugo+rw
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:22 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.651s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Deleted volume successfully.
Sep 25 17:04:22 devstack sudo[92389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d
Sep 25 17:04:22 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68705cd7-d28c-4547-9209-9e8e708f69ac tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-1ba457b4-8fd2-42cf-9145-455063001867-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "cinder-quobyte-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191f3ff-54ba-4053-ae9f-765d64fa5d45]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:23 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" returned: 0 in 0.479s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" released by "_copy_volume_from_snapshot" :: held 10.543s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" released by "_create_volume_from_snapshot" :: held 10.678s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.721s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:23 devstack sudo[92396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9
Sep 25 17:04:23 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d560a7-028d-4a2f-81e2-96dff35784f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d', 'volume_size': 1, 'snapshot_id': 'f2381957-d26c-4502-93e8-4685710d10b4'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aec31c-11ab-4063-a5b2-6bbf4a4e26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Volume volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d (51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d): created successfully
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aec31c-11ab-4063-a5b2-6bbf4a4e26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Flow 'volume_create_manager' (2c23feef-9db6-4a1f-97c6-c04764548015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bfd479dc-d1b8-4b86-a4c1-4ec49f714195 tempest-VolumesDeleteCascade-940433656 None] Created volume successfully.
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Flow 'volume_create_manager' (2052cb71-ea95-440a-b468-9945dac07c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77698dce-85f0-4680-915f-5b83e1d021d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77698dce-85f0-4680-915f-5b83e1d021d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-51185450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e3c87e-60f1-4fb5-88ff-5fd690129323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4799571da0934bbd91728c4a43de21f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:23Z,use_quota=True,user_id='e421098264dc4dcfb0c1362c8ed47054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7830d131-3b4d-4e20-974a-1cf5195d2069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7830d131-3b4d-4e20-974a-1cf5195d2069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96ed20a-c3d7-4b39-9417-604b69dd1397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:04:23 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" returned: 0 in 0.462s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:23 devstack sudo[92403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9
Sep 25 17:04:23 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96ed20a-c3d7-4b39-9417-604b69dd1397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29e3c87e-60f1-4fb5-88ff-5fd690129323', 'volume_name': 'volume-29e3c87e-60f1-4fb5-88ff-5fd690129323', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48aa83e30>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b903bfd-8b90-49cb-a625-8821d5162e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b903bfd-8b90-49cb-a625-8821d5162e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9382f92-d82e-4091-aa48-49f175970eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Volume 29e3c87e-60f1-4fb5-88ff-5fd690129323: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29e3c87e-60f1-4fb5-88ff-5fd690129323', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48aa83e30>}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Trying to clone 29e3c87e-60f1-4fb5-88ff-5fd690129323 from image 21fcf20c-2aec-48a7-986a-08b11deee77e at location (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" returned: 0 in 0.292s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-quobyte-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9" released by "delete_volume" :: held 0.846s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Created reservations ['5a0ea7e9-9574-49b9-adfa-81b07fb8cd04', '49ad25de-9cb6-4102-b8dd-756353019b2a', '9b54e368-3a7e-41ac-bdba-d8e9fa6705f8', '1ad5ecf5-ddb0-47be-ab94-dab7a3cf19aa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:24 devstack sudo[92406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:24 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:04:24 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf1c46-9c60-4d8b-99f6-9a80bc2e2688]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:24 devstack sudo[92409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD
Sep 25 17:04:24 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:24 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Deleted volume successfully.
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ebe421b8-fa4e-417b-b04c-61f68908c2d2 tempest-AttachVolumeTestJSON-1056916763 None] Lock "cinder-8ce8b5f2-e604-44c1-9aa3-9030bf397cf9-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-a0ba99de-434e-463f-9a51-93e50ec5ddf0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-a0ba99de-434e-463f-9a51-93e50ec5ddf0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Performing cascade delete. {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-f2381957-d26c-4502-93e8-4685710d10b4-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-f2381957-d26c-4502-93e8-4685710d10b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:24 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e is fetched for user e421098264dc4dcfb0c1362c8ed47054. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Deleting offline snapshot f2381957-d26c-4502-93e8-4685710d10b4 of volume a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] snapshot_file for this snap is: volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[35536230-564b-4fba-868f-f79cf756bdda]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762429e-5599-4b2f-9bd5-8e7164cabe71]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:25 devstack sudo[92415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:25 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:25 devstack sudo[92416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD
Sep 25 17:04:25 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:25 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-51185450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e3c87e-60f1-4fb5-88ff-5fd690129323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4799571da0934bbd91728c4a43de21f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:23Z,use_quota=True,user_id='e421098264dc4dcfb0c1362c8ed47054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Creating volume 29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:25 devstack sudo[92425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1073741824
Sep 25 17:04:25 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:25 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.546s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f26c8-56a7-48da-b8cc-92abff3c335e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:25 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:25 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:25 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1073741824" returned: 0 in 0.606s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:25 devstack sudo[92436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323
Sep 25 17:04:25 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:26 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:26 devstack sudo[92440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:26 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:26 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Attempting download of 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume 29e3c87e-60f1-4fb5-88ff-5fd690129323. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a206d7a3-6b42-428c-b448-2364d9df0786]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:26 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8
Sep 25 17:04:26 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:26 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.513s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:26 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4
Sep 25 17:04:26 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:26 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8" returned: 0 in 0.383s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:26 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0.f2381957-d26c-4502-93e8-4685710d10b4" returned: 0 in 0.333s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:26 devstack sudo[92455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8
Sep 25 17:04:26 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-f2381957-d26c-4502-93e8-4685710d10b4" released by "_delete_snapshot" :: held 2.159s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" released by "delete_snapshot" :: held 2.199s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Created reservations ['c9f895f1-2b39-40e9-8e0b-7a5123967057', '3c96ba86-c83b-4d70-8a5b-a58580ae0eef', '234d8e0d-1906-4245-be19-db7f25af3ffb', 'e3e30cc0-7472-4447-80c0-ac1adcc190af'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Delete snapshot completed successfully.
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-f2381957-d26c-4502-93e8-4685710d10b4-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Snapshots deleted, issuing volume delete {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b0b74-d6e1-4064-8b4b-e131a1629f94]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:27 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8" returned: 1 in 0.466s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_kvo425d8' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7124ab5b-ba8d-4414-9dc9-0177a7e95536]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:27 devstack sudo[92462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:27 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:27 devstack sudo[92463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD
Sep 25 17:04:27 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:27 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] 21fcf20c-2aec-48a7-986a-08b11deee77e was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:27 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323
Sep 25 17:04:27 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:27 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.621s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:27 devstack sudo[92476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0
Sep 25 17:04:27 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:28 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a0ba99de-434e-463f-9a51-93e50ec5ddf0" returned: 0 in 0.450s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-a0ba99de-434e-463f-9a51-93e50ec5ddf0" released by "delete_volume" :: held 1.174s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Created reservations ['f4000522-0424-46ec-b419-7bf3c1ceb9f2', '7a99a054-7b2b-42a6-8dd3-d838913c7378', '0c841add-7fdb-469b-8746-4fcc1f58f3c2', 'b5ea1319-3bd5-4358-933e-0aeb02491b24'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:28 devstack sudo[92520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:28 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:29 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.470s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Deleted volume successfully.
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7d392a83-db56-4145-b5c6-e1ac897230bc tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-a0ba99de-434e-463f-9a51-93e50ec5ddf0-delete_volume" released by "delete_volume" :: held 4.592s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[76398c0a-f717-467d-9e70-d75c1ba2b374]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:29 devstack sudo[92541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d
Sep 25 17:04:29 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:30 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" returned: 0 in 0.544s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:30 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d
Sep 25 17:04:30 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:30 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" returned: 0 in 0.374s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2d9d3e8f-76b3-4b85-bf22-12d6bfd66756 req-689f60e2-eae7-41d4-88aa-04ee33c6814a tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2d9d3e8f-76b3-4b85-bf22-12d6bfd66756 req-689f60e2-eae7-41d4-88aa-04ee33c6814a tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-quobyte-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d" released by "delete_volume" :: held 1.035s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2d9d3e8f-76b3-4b85-bf22-12d6bfd66756 req-689f60e2-eae7-41d4-88aa-04ee33c6814a tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-2d9d3e8f-76b3-4b85-bf22-12d6bfd66756 req-689f60e2-eae7-41d4-88aa-04ee33c6814a tempest-TaggedAttachmentsTest-1081787216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-21ee184d-27f2-47fa-a985-e7fb82919d53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44aebd0c-18f7-467e-83fc-fe652f4b8c24', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Created reservations ['63f1b751-dbd8-4f0d-93db-bb49734f1c91', 'e27f42f2-24d3-4bea-93a0-710ca881f675', 'fab4d270-35e5-48ba-b7b6-95ca1a898075', 'f9b550e5-2955-44b8-8b7e-978d05d41466'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-2d9d3e8f-76b3-4b85-bf22-12d6bfd66756 req-689f60e2-eae7-41d4-88aa-04ee33c6814a tempest-TaggedAttachmentsTest-1081787216 None] attachment_update completed successfully.
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:30 devstack sudo[92567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:30 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:31 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323" returned: 0 in 3.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_owdsc_p4devstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:04:31 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Converted 112.00 MB image at 34.32 MB/s
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:31 devstack sudo[92592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1G
Sep 25 17:04:31 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:31 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.397s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Deleted volume successfully.
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1e1ac981-ad15-4c05-8a0e-063f07a7c756 tempest-VolumesDeleteCascade-940433656 None] Lock "cinder-51b5ae8a-8c3d-4c1c-a841-3a8e3e9b939d-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:31 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 1G" returned: 0 in 0.520s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Downloaded image 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume 29e3c87e-60f1-4fb5-88ff-5fd690129323 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e for user e421098264dc4dcfb0c1362c8ed47054 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Marking volume 29e3c87e-60f1-4fb5-88ff-5fd690129323 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Copying metadata from image 21fcf20c-2aec-48a7-986a-08b11deee77e to 29e3c87e-60f1-4fb5-88ff-5fd690129323. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Creating volume glance metadata for volume 29e3c87e-60f1-4fb5-88ff-5fd690129323 backed by image 21fcf20c-2aec-48a7-986a-08b11deee77e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9382f92-d82e-4091-aa48-49f175970eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e3c87e-60f1-4fb5-88ff-5fd690129323', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48aa83e30>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5086cbec-0750-4246-b8dc-b8a4d2dbc6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Volume volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 (29e3c87e-60f1-4fb5-88ff-5fd690129323): created successfully
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5086cbec-0750-4246-b8dc-b8a4d2dbc6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Flow 'volume_create_manager' (2052cb71-ea95-440a-b468-9945dac07c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-adde6955-281c-49e9-8c6a-b396492569c1 tempest-ServerActionsTestOtherA-1511814876 None] Created volume successfully.
Sep 25 17:04:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-af0e048c-a425-4f6e-90e1-318c8e3ddeee req-132e8117-8649-4475-9717-e284f1d59605 tempest-TaggedAttachmentsTest-1081787216 None] Terminate volume connection completed successfully.
Sep 25 17:04:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-af0e048c-a425-4f6e-90e1-318c8e3ddeee req-132e8117-8649-4475-9717-e284f1d59605 tempest-TaggedAttachmentsTest-1081787216 None] Deleting attachment 44aebd0c-18f7-467e-83fc-fe652f4b8c24. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:04:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Flow 'volume_create_manager' (dcdcadc3-f5ce-4d6a-8a0b-84ca257bdbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b788897-af93-4e14-80d9-5cff10a63ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b788897-af93-4e14-80d9-5cff10a63ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1419883799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7751430b-e4fe-405d-99f2-b11f74579158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd6fb12c60b4bc294bdc2e22101b3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:36Z,use_quota=True,user_id='d5210f736b164ce5abfe5f4fed2a0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce33784-40f3-40fd-80cc-9ad7d4c351db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce33784-40f3-40fd-80cc-9ad7d4c351db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4b14f0-e616-4da8-800b-085628e416ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4b14f0-e616-4da8-800b-085628e416ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7751430b-e4fe-405d-99f2-b11f74579158', 'volume_name': 'volume-7751430b-e4fe-405d-99f2-b11f74579158', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b2f27b-2b0b-44f1-8867-2c6794f90d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b2f27b-2b0b-44f1-8867-2c6794f90d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11d5697-d66e-457b-a203-75c834c279e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Volume 7751430b-e4fe-405d-99f2-b11f74579158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7751430b-e4fe-405d-99f2-b11f74579158', 'volume_size': 1}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1419883799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7751430b-e4fe-405d-99f2-b11f74579158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd6fb12c60b4bc294bdc2e22101b3f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:36Z,use_quota=True,user_id='d5210f736b164ce5abfe5f4fed2a0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Creating volume 7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:36 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-bb6af640-e729-4f4d-9baf-bdae03dc1300 req-5febc3cc-9710-4c7c-a54d-8eb99db81e5b tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:36 devstack sudo[93061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 1073741824
Sep 25 17:04:36 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:36 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 1073741824" returned: 0 in 0.621s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:36 devstack sudo[93068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158
Sep 25 17:04:36 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:37 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158" returned: 0 in 0.330s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-bb6af640-e729-4f4d-9baf-bdae03dc1300 req-5febc3cc-9710-4c7c-a54d-8eb99db81e5b tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.029s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11d5697-d66e-457b-a203-75c834c279e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7751430b-e4fe-405d-99f2-b11f74579158', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e893079-0f44-4c10-8dc1-9914f5dd20b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-bb6af640-e729-4f4d-9baf-bdae03dc1300 req-5febc3cc-9710-4c7c-a54d-8eb99db81e5b tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Volume volume-7751430b-e4fe-405d-99f2-b11f74579158 (7751430b-e4fe-405d-99f2-b11f74579158): created successfully
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e893079-0f44-4c10-8dc1-9914f5dd20b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Flow 'volume_create_manager' (dcdcadc3-f5ce-4d6a-8a0b-84ca257bdbe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f6194c94-925c-47cc-855d-382897a14dff req-97ae7802-f2e2-4f27-86e6-2ec6a565971a tempest-VolumesSnapshotsTestJSON-1543833896 None] Created volume successfully.
Sep 25 17:04:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-bb6af640-e729-4f4d-9baf-bdae03dc1300 req-5febc3cc-9710-4c7c-a54d-8eb99db81e5b tempest-ServerActionsTestOtherA-1511814876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-29e3c87e-60f1-4fb5-88ff-5fd690129323', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25813616-ee24-4e08-89c0-3dea756f84ba', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:04:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-bb6af640-e729-4f4d-9baf-bdae03dc1300 req-5febc3cc-9710-4c7c-a54d-8eb99db81e5b tempest-ServerActionsTestOtherA-1511814876 None] attachment_update completed successfully.
Sep 25 17:04:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Creating offline snapshot 37499fbd-489f-4df5-8852-8b181b4097bb of volume 7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:04:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4c0fc9-f771-4ef9-9a1a-6c93aa3d4b05]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:38 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158
Sep 25 17:04:38 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:39 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158" returned: 0 in 0.591s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:39 devstack sudo[93080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb 1G
Sep 25 17:04:39 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:39 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb 1G" returned: 0 in 0.687s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7751430b-e4fe-405d-99f2-b11f74579158 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:39 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7751430b-e4fe-405d-99f2-b11f74579158 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb
Sep 25 17:04:39 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Flow 'volume_create_manager' (2e3f5df8-e5c4-44f4-8518-eb46b445b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8250e7-4660-413b-bf44-11c0a13fcea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8250e7-4660-413b-bf44-11c0a13fcea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-920503476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418a5417-5a70-4c3f-a261-29f2c9d9b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f9f98849b844828337dc0089bccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:40Z,use_quota=True,user_id='ed9062abbc1a4a6881002548b02e4b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5fe1c4-f7c9-49d3-9858-b87263985bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5fe1c4-f7c9-49d3-9858-b87263985bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a101629f-bd82-435b-be7d-3c2ac1f57c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a101629f-bd82-435b-be7d-3c2ac1f57c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418a5417-5a70-4c3f-a261-29f2c9d9b59b', 'volume_name': 'volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf4f96-faba-493e-805a-b4a5bcd63138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf4f96-faba-493e-805a-b4a5bcd63138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada29dc2-cd5c-4643-b62e-89bbfb34691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Volume 418a5417-5a70-4c3f-a261-29f2c9d9b59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b', 'volume_size': 1}
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:40 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7751430b-e4fe-405d-99f2-b11f74579158 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:40 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb is being set with open permissions: ugo+rw
Sep 25 17:04:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:40 devstack sudo[93288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb
Sep 25 17:04:40 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:41 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb" returned: 0 in 0.449s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:41 devstack sudo[93556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info
Sep 25 17:04:41 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:41 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info" returned: 0 in 0.489s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:41 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info is being set with open permissions: ugo+rw
Sep 25 17:04:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:41 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info
Sep 25 17:04:41 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:41 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.info" returned: 0 in 0.394s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.501s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-920503476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418a5417-5a70-4c3f-a261-29f2c9d9b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f9f98849b844828337dc0089bccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:40Z,use_quota=True,user_id='ed9062abbc1a4a6881002548b02e4b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Creating volume 418a5417-5a70-4c3f-a261-29f2c9d9b59b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:42 devstack sudo[93581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b 1073741824
Sep 25 17:04:42 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-c854bde8-e8a7-493f-91bc-7012eba0103b req-750f09ab-7ca2-47f8-ae96-784438af8545 tempest-VolumesSnapshotsTestJSON-1543833896 None] Create snapshot completed successfully
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "cinder-37499fbd-489f-4df5-8852-8b181b4097bb-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-37499fbd-489f-4df5-8852-8b181b4097bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:42 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b 1073741824" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "cinder-quobyte-37499fbd-489f-4df5-8852-8b181b4097bb" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-37499fbd-489f-4df5-8852-8b181b4097bb" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Deleting offline snapshot 37499fbd-489f-4df5-8852-8b181b4097bb of volume 7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] snapshot_file for this snap is: volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9681f6-2888-4c73-9ec5-d7d24377b7c8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:42 devstack sudo[93603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b
Sep 25 17:04:42 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:43 devstack sudo[93602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb
Sep 25 17:04:43 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:43 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b" returned: 0 in 0.487s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada29dc2-cd5c-4643-b62e-89bbfb34691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ca531c-30f9-46b4-b2f7-64c98326543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Volume volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b (418a5417-5a70-4c3f-a261-29f2c9d9b59b): created successfully
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ca531c-30f9-46b4-b2f7-64c98326543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Flow 'volume_create_manager' (2e3f5df8-e5c4-44f4-8518-eb46b445b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7275f229-58d2-4629-9c9d-79633bf39bb2 tempest-VolumesTransfersTest-80184579 None] Created volume successfully.
Sep 25 17:04:43 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb" returned: 0 in 0.583s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7751430b-e4fe-405d-99f2-b11f74579158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16da55-d2d6-44a8-886b-4843568beebc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:43 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158
Sep 25 17:04:43 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:44 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158" returned: 0 in 0.577s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:44 devstack sudo[93620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb
Sep 25 17:04:44 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:44 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb" returned: 0 in 0.481s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:44 devstack sudo[93625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb
Sep 25 17:04:44 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:45 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158.37499fbd-489f-4df5-8852-8b181b4097bb" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-37499fbd-489f-4df5-8852-8b181b4097bb" released by "_delete_snapshot" :: held 2.288s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" released by "delete_snapshot" :: held 2.342s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:45 devstack cinder-volume[86955]: DEBUG cinder.quota [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Created reservations ['dff7768f-40d5-41f9-8eda-fdf87c477c21', '2beee716-632b-4c33-ae63-d6a9fb776056', '05e7ed50-b054-44e8-b0ff-7f99091761a6', 'b809320e-32b9-4c5d-bd74-d22fee452f10'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b91f61a8-84fc-44d1-a590-8692599c2f20 tempest-VolumesTransfersTest-315213601 None] Transfer volume completed successfully.
Sep 25 17:04:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Delete snapshot completed successfully.
Sep 25 17:04:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-f27365e8-78c0-40ee-b769-e4502e18e681 req-6fd51a3b-7c3e-4a2b-8649-c1ab56b4b637 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-37499fbd-489f-4df5-8852-8b181b4097bb-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "cinder-418a5417-5a70-4c3f-a261-29f2c9d9b59b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-418a5417-5a70-4c3f-a261-29f2c9d9b59b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "cinder-7751430b-e4fe-405d-99f2-b11f74579158-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-7751430b-e4fe-405d-99f2-b11f74579158-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "cinder-quobyte-418a5417-5a70-4c3f-a261-29f2c9d9b59b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-quobyte-418a5417-5a70-4c3f-a261-29f2c9d9b59b" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930c993-cd39-4bbb-b5ad-e7db5e32f552]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" acquired by "delete_volume" :: waited 0.059s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[21048608-97cd-48ba-affa-4d81bf2d95fc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:46 devstack sudo[93628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b
Sep 25 17:04:46 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:46 devstack sudo[93629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158
Sep 25 17:04:46 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:47 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:47 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b
Sep 25 17:04:47 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:47 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158" returned: 0 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:47 devstack sudo[93643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158
Sep 25 17:04:47 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "cinder-21ee184d-27f2-47fa-a985-e7fb82919d53-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "cinder-21ee184d-27f2-47fa-a985-e7fb82919d53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "cinder-quobyte-21ee184d-27f2-47fa-a985-e7fb82919d53" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "cinder-quobyte-21ee184d-27f2-47fa-a985-e7fb82919d53" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[74539755-b964-4223-b455-e8f34b1405c4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:47 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7751430b-e4fe-405d-99f2-b11f74579158" returned: 0 in 0.423s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-quobyte-7751430b-e4fe-405d-99f2-b11f74579158" released by "delete_volume" :: held 1.373s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:48 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-418a5417-5a70-4c3f-a261-29f2c9d9b59b" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-quobyte-418a5417-5a70-4c3f-a261-29f2c9d9b59b" released by "delete_volume" :: held 1.549s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:48 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53
Sep 25 17:04:48 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.quota [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Created reservations ['f02b7d81-eedc-4c13-8044-6d68f6f6f6a8', '64577ff5-d7f3-4f2b-a8f5-e2ab410cfcb3', '4308010c-3dd9-4fb2-af7b-c94848ff270d', 'fdafa222-a256-49f9-9f7a-33f4f4b1eb10'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Created reservations ['4293828e-2d27-4a5a-b483-3af568254ad2', 'd6c1daec-dd5e-4dfa-9d3b-4848011576fa', '846e1f93-df0e-4e77-a705-c5db1d2aaf8e', '32e5942f-4785-44b8-b784-bc9777cc8898'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:48 devstack sudo[93652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:48 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:48 devstack sudo[93654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:48 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:48 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.415s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Deleted volume successfully.
Sep 25 17:04:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cb3a814d-63bb-4a81-baa8-97228b03da46 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-418a5417-5a70-4c3f-a261-29f2c9d9b59b-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:49 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53" returned: 0 in 1.079s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:49 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.manager [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Deleted volume successfully.
Sep 25 17:04:49 devstack sudo[93661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53
Sep 25 17:04:49 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-1df8f790-a65a-4fed-90e8-cfbb7be4ba66 req-d9107905-92b2-4635-a969-203da47674a9 tempest-VolumesSnapshotsTestJSON-1543833896 None] Lock "cinder-7751430b-e4fe-405d-99f2-b11f74579158-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:49 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-21ee184d-27f2-47fa-a985-e7fb82919d53" returned: 0 in 0.509s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "cinder-quobyte-21ee184d-27f2-47fa-a985-e7fb82919d53" released by "delete_volume" :: held 1.661s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Created reservations ['1bf97e9d-945c-4b5c-8242-82e145bd524c', 'f5ffbd1d-0df8-4c3d-851a-a9ee3803323e', '4bdcbf38-7e75-48a7-a782-afd6b40e5b30', '88bdc703-8ed3-4597-be9a-9b30911ab802'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:50 devstack sudo[93665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:50 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Flow 'volume_create_manager' (5c9462c3-4478-426d-8455-f2f8d141ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a058d2-9e68-46de-871b-10f462e92c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:50 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.489s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Deleted volume successfully.
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a058d2-9e68-46de-871b-10f462e92c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-846777458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f9f98849b844828337dc0089bccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:50Z,use_quota=True,user_id='ed9062abbc1a4a6881002548b02e4b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f314e0c8-8040-4a7c-b3c8-8f2c83352106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f314e0c8-8040-4a7c-b3c8-8f2c83352106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d965758-24d5-4633-966f-51f7d6d1b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d965758-24d5-4633-966f-51f7d6d1b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912', 'volume_name': 'volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0087d06-d3e3-450a-99da-945d3426f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0087d06-d3e3-450a-99da-945d3426f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71af67bf-75c0-4475-8220-631e638f593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Volume ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912', 'volume_size': 1}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-846777458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f9f98849b844828337dc0089bccbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:50Z,use_quota=True,user_id='ed9062abbc1a4a6881002548b02e4b5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Creating volume ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:04:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b17cc36e-27e2-4754-8999-99941214587f tempest-TaggedAttachmentsTest-1081787216 None] Lock "cinder-21ee184d-27f2-47fa-a985-e7fb82919d53-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:50 devstack sudo[93670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 1073741824
Sep 25 17:04:50 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:51 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 1073741824" returned: 0 in 0.655s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:51 devstack sudo[93676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912
Sep 25 17:04:51 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:51 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71af67bf-75c0-4475-8220-631e638f593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09919cb-a13f-445f-8580-3db9b1f512ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:04:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Volume volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 (ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912): created successfully
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09919cb-a13f-445f-8580-3db9b1f512ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:04:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Flow 'volume_create_manager' (5c9462c3-4478-426d-8455-f2f8d141ec90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:04:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1986777b-9bf5-4307-8ea8-5f3cb8027d46 tempest-VolumesTransfersTest-80184579 None] Created volume successfully.
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "cinder-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "cinder-quobyte-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-quobyte-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d83d6-c960-412d-9ccc-fbeba727e3d7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:04:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:52 devstack sudo[93681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912
Sep 25 17:04:52 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:53 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" returned: 0 in 0.597s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:53 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912
Sep 25 17:04:53 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:53 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" returned: 0 in 0.640s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-quobyte-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912" released by "delete_volume" :: held 1.301s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Created reservations ['48d02d05-bc6b-4bc9-8c07-1662f9b322ee', 'd86ceef2-535f-4d7d-b150-cadce0db85f0', '657f7e03-8903-458a-ab6a-33f773b88159', 'bf1d05a8-e0bf-4618-98c6-bef30067c05f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:04:54 devstack sudo[93691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:04:54 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:04:54 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.486s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:04:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Deleted volume successfully.
Sep 25 17:04:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fbe63016-6ed7-428b-a7aa-1b728cf62811 tempest-VolumesTransfersTest-1572927609 None] Lock "cinder-ac6ba3ac-bc39-4b97-ae05-9b0f74d6a912-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:04:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-34a96c5c-91ed-419b-8270-2732c45e3956 tempest-ServerActionsTestOtherA-1511814876 None] Terminate volume connection completed successfully.
Sep 25 17:04:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-34a96c5c-91ed-419b-8270-2732c45e3956 tempest-ServerActionsTestOtherA-1511814876 None] Deleting attachment 25813616-ee24-4e08-89c0-3dea756f84ba. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:04:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94ff6b42-b329-4103-bd52-37d2a99cf126 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-1956117275: creating
Sep 25 17:04:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94ff6b42-b329-4103-bd52-37d2a99cf126 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-1956117275: created successfully
Sep 25 17:04:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94ff6b42-b329-4103-bd52-37d2a99cf126 tempest-GroupSnapshotsTest-1471183822 None] Create group completed successfully.
Sep 25 17:05:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (4f53bdc0-3a18-4ebb-a760-c913b3c92493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc41a12-4929-4841-a1ce-0a86e25b9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc41a12-4929-4841-a1ce-0a86e25b9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120520354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4fda7b6-1668-47d0-b02b-5bef624bbb91,host='devstack@QuobyteHD#QuobyteHD',id=585cda21-d4f7-490c-9a62-ff95d41514a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:01Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25cb0652-9e91-41f6-bae7-119612de4744),volume_type_id=25cb0652-9e91-41f6-bae7-119612de4744)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbb4a9a-62a7-42f8-aa01-c243df376cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbb4a9a-62a7-42f8-aa01-c243df376cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08689471-1679-41b7-84a3-c37f1b3526e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08689471-1679-41b7-84a3-c37f1b3526e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585cda21-d4f7-490c-9a62-ff95d41514a1', 'volume_name': 'volume-585cda21-d4f7-490c-9a62-ff95d41514a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7766f9e-3c37-4ee4-8704-3b5dd3afb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7766f9e-3c37-4ee4-8704-3b5dd3afb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271340ca-a793-432a-9080-454bf5f5554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Volume 585cda21-d4f7-490c-9a62-ff95d41514a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585cda21-d4f7-490c-9a62-ff95d41514a1', 'volume_size': 1}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d4fda7b6-1668-47d0-b02b-5bef624bbb91,created_at=2026-09-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120520354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4fda7b6-1668-47d0-b02b-5bef624bbb91,host='devstack@QuobyteHD#QuobyteHD',id=585cda21-d4f7-490c-9a62-ff95d41514a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:01Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25cb0652-9e91-41f6-bae7-119612de4744),volume_type_id=25cb0652-9e91-41f6-bae7-119612de4744)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Creating volume 585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:01 devstack sudo[93750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 1073741824
Sep 25 17:05:01 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-fad4bbfe-65fa-4c1d-ab31-2e0d6366cae3 tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:01 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 1073741824" returned: 0 in 0.576s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:01 devstack sudo[93767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:01 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:02 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 0.324s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-fad4bbfe-65fa-4c1d-ab31-2e0d6366cae3 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.645s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271340ca-a793-432a-9080-454bf5f5554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585cda21-d4f7-490c-9a62-ff95d41514a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a93ab36-9011-42a6-ba75-8c66dd1009cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-fad4bbfe-65fa-4c1d-ab31-2e0d6366cae3 tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Volume volume-585cda21-d4f7-490c-9a62-ff95d41514a1 (585cda21-d4f7-490c-9a62-ff95d41514a1): created successfully
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a93ab36-9011-42a6-ba75-8c66dd1009cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (4f53bdc0-3a18-4ebb-a760-c913b3c92493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bf7ed935-1087-4c3a-b622-5b86c2325c46 tempest-GroupSnapshotsTest-1471183822 None] Created volume successfully.
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-fad4bbfe-65fa-4c1d-ab31-2e0d6366cae3 tempest-ServerActionsTestOtherA-1511814876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-29e3c87e-60f1-4fb5-88ff-5fd690129323', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad6448f9-4d0a-4c0e-9166-d710de7da4cc', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:05:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-fe1e0c25-0dd0-4df0-a72e-6577a2f20642 req-fad4bbfe-65fa-4c1d-ab31-2e0d6366cae3 tempest-ServerActionsTestOtherA-1511814876 None] attachment_update completed successfully.
Sep 25 17:05:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] GroupSnapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: creating.
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Group snapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Creating offline snapshot f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 of volume 585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80e1c7-0762-4cb7-85ab-9e7cf371479c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:03 devstack sudo[93865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:03 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:03 devstack sudo[94201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:03 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:03 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 0.854s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:03 devstack sudo[94210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 1G
Sep 25 17:05:03 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:03 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.383s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:05:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:05:04 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 1G" returned: 0 in 0.635s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585cda21-d4f7-490c-9a62-ff95d41514a1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:04 devstack sudo[94228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585cda21-d4f7-490c-9a62-ff95d41514a1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:04 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:04 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585cda21-d4f7-490c-9a62-ff95d41514a1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.538s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:04 devstack sudo[94243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:04 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:05 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.399s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:05 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info
Sep 25 17:05:05 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:05 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info" returned: 0 in 0.451s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:05 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:05 devstack sudo[94260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info
Sep 25 17:05:05 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Flow 'volume_create_manager' (6f4e4e95-bdec-4dfe-b979-054e67ba3d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed41796-8e45-4536-9ea2-f843df44439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed41796-8e45-4536-9ea2-f843df44439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1743308033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c80e863-09e1-4bbf-b6dc-250885854929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3408524f57a14e58846374b5653b2be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:06Z,use_quota=True,user_id='5d02c7924ad644268e380ebad60e7708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a312b67-7d2e-4a1e-ae06-f3cecabea740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a312b67-7d2e-4a1e-ae06-f3cecabea740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305b99e-7d11-4d8b-8085-ec0295e98fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305b99e-7d11-4d8b-8085-ec0295e98fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c80e863-09e1-4bbf-b6dc-250885854929', 'volume_name': 'volume-2c80e863-09e1-4bbf-b6dc-250885854929', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdc51c1-50df-4d01-97f6-ebb43f64f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdc51c1-50df-4d01-97f6-ebb43f64f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3d6d1-1d8c-42ac-8179-420c262bebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Volume 2c80e863-09e1-4bbf-b6dc-250885854929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c80e863-09e1-4bbf-b6dc-250885854929', 'volume_size': 1}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:06 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.info" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.394s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1743308033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c80e863-09e1-4bbf-b6dc-250885854929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3408524f57a14e58846374b5653b2be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:06Z,use_quota=True,user_id='5d02c7924ad644268e380ebad60e7708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Creating volume 2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:06 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:05:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:06 devstack sudo[94264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 1073741824
Sep 25 17:05:06 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-83b4bd58-af87-4664-b3ba-a134a490ae93 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: created successfully
Sep 25 17:05:07 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 1073741824" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:07 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:07 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:07 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.365s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3d6d1-1d8c-42ac-8179-420c262bebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c80e863-09e1-4bbf-b6dc-250885854929', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2921c11b-3ef2-470d-878a-045cf8ee3a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Volume volume-2c80e863-09e1-4bbf-b6dc-250885854929 (2c80e863-09e1-4bbf-b6dc-250885854929): created successfully
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2921c11b-3ef2-470d-878a-045cf8ee3a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Flow 'volume_create_manager' (6f4e4e95-bdec-4dfe-b979-054e67ba3d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-674856d3-4f91-4abd-a1e2-7cb6619ae3ef tempest-VolumesCloneTest-1257502163 None] Created volume successfully.
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=125,cinder:INSERT=37,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=113,cinder:UPDATE=117,cinder:DELETE=8,cinder:INSERT=30 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Creating volume 81f42d29-0cc4-42f4-9fc6-cdfb034024e5 from snapshot f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] snapshot: f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51, volume: 81f42d29-0cc4-42f4-9fc6-cdfb034024e5,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cf3739-9a78-4aab-a5d6-a459153d2fa2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:09 devstack sudo[94278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:09 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Flow 'volume_create_manager' (bf621e50-7e2d-454f-b708-41d46b95dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:09 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe142db4-e1f1-45cf-acd7-6f52650352be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.865s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-585cda21-d4f7-490c-9a62-ff95d41514a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe142db4-e1f1-45cf-acd7-6f52650352be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-925444330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb898f4-dd5d-445a-aa99-6aab6d923d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3408524f57a14e58846374b5653b2be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=2c80e863-09e1-4bbf-b6dc-250885854929,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:10Z,use_quota=True,user_id='5d02c7924ad644268e380ebad60e7708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4072b41c-0dfa-49a6-9369-258e5359669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4072b41c-0dfa-49a6-9369-258e5359669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f98830b-042d-424d-bff8-bd8c56e60c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb4519a-2307-4cdb-8780-a1e1ef53da2e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f98830b-042d-424d-bff8-bd8c56e60c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1bb898f4-dd5d-445a-aa99-6aab6d923d45', 'volume_name': 'volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45', 'volume_size': 2, 'source_volid': '2c80e863-09e1-4bbf-b6dc-250885854929', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cdb62e-8e0c-482c-9c8b-215854828dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cdb62e-8e0c-482c-9c8b-215854828dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b26a73-6785-4a0f-bfaa-e065cd67c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Volume 1bb898f4-dd5d-445a-aa99-6aab6d923d45: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45', 'volume_size': 2, 'source_volid': '2c80e863-09e1-4bbf-b6dc-250885854929', 'source_volstatus': 'available'}
Sep 25 17:05:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:09 devstack sudo[94283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:09 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:10 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:05:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:05:10 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:05:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:10 devstack sudo[94289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5
Sep 25 17:05:10 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:19 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:05:19 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:05:20 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" returned: 0 in 10.222s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:20 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1, size 1024.00 MB, duration 10.22 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:05:20 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Converted 1024.00 MB image at 100.15 MB/s
Sep 25 17:05:20 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:20 devstack sudo[94313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5
Sep 25 17:05:20 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:21 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" released by "_copy_volume_from_snapshot" :: held 12.357s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" released by "_create_volume_from_snapshot" :: held 12.521s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.566s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.258s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:21 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Cloning volume 2c80e863-09e1-4bbf-b6dc-250885854929 to volume 1bb898f4-dd5d-445a-aa99-6aab6d923d45
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Creating offline snapshot 32fd6091-18c2-43f7-a4a7-3463dc08426a of volume 2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[26364a3d-cabc-4310-b9b5-c9b359c501a5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-eecefb07-90f1-4872-b401-68409dcc98ee tempest-GroupSnapshotsTest-1471183822 None] Create group from source-snapshot-29357235-aa43-4e22-abd6-3f366b92b5d3 completed successfully.
Sep 25 17:05:21 devstack sudo[94316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:21 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:21 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.435s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:21 devstack sudo[94321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a 1G
Sep 25 17:05:21 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:22 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a 1G" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c80e863-09e1-4bbf-b6dc-250885854929 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:22 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c80e863-09e1-4bbf-b6dc-250885854929 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:22 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:22 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c80e863-09e1-4bbf-b6dc-250885854929 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.515s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:22 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a is being set with open permissions: ugo+rw
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:22 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:22 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057f27b-0707-4033-af62-cd1d8dfefa13]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:23 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5
Sep 25 17:05:23 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:23 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.413s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:23 devstack sudo[94380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info
Sep 25 17:05:23 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:23 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" returned: 0 in 0.616s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:23 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:23 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5
Sep 25 17:05:23 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info" returned: 0 in 0.328s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info is being set with open permissions: ugo+rw
Sep 25 17:05:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:23 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info
Sep 25 17:05:23 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:24 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.info" returned: 0 in 0.348s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] snapshot: 32fd6091-18c2-43f7-a4a7-3463dc08426a, volume: 1bb898f4-dd5d-445a-aa99-6aab6d923d45,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:24 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" returned: 0 in 0.489s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-81f42d29-0cc4-42f4-9fc6-cdfb034024e5" released by "delete_volume" :: held 1.170s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391f603-4671-43f9-b606-1ea34ff069bd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['d0155da0-6a6c-4335-ae3f-f86963a2e626'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:24 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1481421617 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1481421617, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:05:24 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1481421617 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1481421617, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:05:24 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:24 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['d672ba4a-342a-4e71-aba9-b55f5648079d', 'f7a28ba3-f5d3-4d15-941c-c69c3310fd09', '8829fc61-f1ea-4bec-8579-7c9f6fe15eaa', '6736f4b3-be08-4066-adba-8e54fc2fb231'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:24 devstack sudo[94417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:24 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:24 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.596s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c80e863-09e1-4bbf-b6dc-250885854929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe95a16-5696-449c-a4cb-1e9744d02b44]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:24 devstack sudo[94421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:24 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:24 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5b591695-ae46-4a27-b21a-e1ab002c2132 tempest-GroupSnapshotsTest-1471183822 None] Delete group completed successfully.
Sep 25 17:05:25 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.419s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:25 devstack sudo[94432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45
Sep 25 17:05:25 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: deleting
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Deleting offline snapshot f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 of volume 585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] snapshot_file for this snap is: volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee508bf3-fc7b-4243-b273-49411e8e8dd8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:26 devstack sudo[94437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:26 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:26 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-585cda21-d4f7-490c-9a62-ff95d41514a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:05:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc62460f-3271-4197-964f-e1c4cf2a1974]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:26 devstack sudo[94450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:26 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:27 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 1.024s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:27 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:27 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:28 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:28 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51
Sep 25 17:05:28 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:28 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1.f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" returned: 0 in 0.478s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-f54eb4f0-c5c6-438b-bd0c-ec5fec9fbc51" released by "_delete_snapshot" :: held 3.288s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" released by "delete_snapshot" :: held 3.331s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:29 devstack cinder-volume[86955]: WARNING cinder.quota [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1481421617 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1481421617, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:05:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['55ff76c0-ebd5-42a1-b0ef-3d7a03254a4a', '0aa8770d-7ccf-42a9-9306-e2fbe93c9a6e', '1ba2700c-6bd4-458d-a1dc-c654c55d6d01', 'dc9c7404-9801-4582-aede-453e5e462cd6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12afc454-931f-4723-8102-72add29490c4 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 29357235-aa43-4e22-abd6-3f366b92b5d3: deleted successfully
Sep 25 17:05:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e064c6-17d2-407b-aa09-38d20b07b9fc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:31 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:31 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:32 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 0.923s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:32 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1
Sep 25 17:05:32 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:33 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-585cda21-d4f7-490c-9a62-ff95d41514a1" returned: 0 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-585cda21-d4f7-490c-9a62-ff95d41514a1" released by "delete_volume" :: held 1.947s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['3aad5448-9d6c-40ec-9108-f09c768c0a77'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:33 devstack cinder-volume[86955]: WARNING cinder.db.api [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1481421617']
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['3205d141-133e-41e0-8e8b-bd1a3dc67006', '0f7eac1e-a358-4ec1-aeec-94acd2cfd329', 'd8edab75-28b8-4f37-9ff3-e1a83d417deb', '0fa07fce-de3d-4673-9f79-3ebadc2b2bf5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:33 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45" returned: 0 in 8.471s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:05:33 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Converted 1024.00 MB image at 120.85 MB/s
Sep 25 17:05:33 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 is being set with open permissions: ugo+rw
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:33 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:33 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:33 devstack sudo[94482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45
Sep 25 17:05:33 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:33 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45" returned: 0 in 0.299s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" released by "_copy_volume_from_snapshot" :: held 9.914s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:34 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.338s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-quobyte-32fd6091-18c2-43f7-a4a7-3463dc08426a" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0a64bea8-1710-434a-873a-b8c01690d6de tempest-GroupSnapshotsTest-1471183822 None] Delete group completed successfully.
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-32fd6091-18c2-43f7-a4a7-3463dc08426a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Deleting offline snapshot 32fd6091-18c2-43f7-a4a7-3463dc08426a of volume 2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] snapshot_file for this snap is: volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5ebe8-37cb-420d-aafa-0d9f151ab0e9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:34 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:34 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:34 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.431s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c80e863-09e1-4bbf-b6dc-250885854929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d40a51-a178-47b7-b008-1b269055458a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:34 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:34 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6d89cdc3-b7f1-40ba-a0b7-bcc439e227a5 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-1522734765: creating
Sep 25 17:05:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6d89cdc3-b7f1-40ba-a0b7-bcc439e227a5 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-1522734765: created successfully
Sep 25 17:05:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6d89cdc3-b7f1-40ba-a0b7-bcc439e227a5 tempest-GroupSnapshotsTest-1471183822 None] Create group completed successfully.
Sep 25 17:05:35 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:35 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:35 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:35 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.359s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:35 devstack sudo[94502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a
Sep 25 17:05:35 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:35 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929.32fd6091-18c2-43f7-a4a7-3463dc08426a" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-32fd6091-18c2-43f7-a4a7-3463dc08426a" released by "_delete_snapshot" :: held 1.825s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.820s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b26a73-6785-4a0f-bfaa-e065cd67c879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45', 'volume_size': 2, 'source_volid': '2c80e863-09e1-4bbf-b6dc-250885854929', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acf00a7-cf66-470a-afb2-9e6c763d4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Volume volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 (1bb898f4-dd5d-445a-aa99-6aab6d923d45): created successfully
Sep 25 17:05:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acf00a7-cf66-470a-afb2-9e6c763d4db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Flow 'volume_create_manager' (bf621e50-7e2d-454f-b708-41d46b95dadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0440e02e-d9a3-49a0-91a6-b8b3eaaaa4a5 tempest-VolumesCloneTest-1257502163 None] Created volume successfully.
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-1bb898f4-dd5d-445a-aa99-6aab6d923d45-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "cinder-1bb898f4-dd5d-445a-aa99-6aab6d923d45-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fa6574-f7e8-4cee-9988-98a2c00b0328]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (fd8c5c7c-838d-456c-bc4f-1ebda2cff107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d450a6f-3a73-4c25-929a-41d64092a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d450a6f-3a73-4c25-929a-41d64092a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197174838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,host='devstack@QuobyteHD#QuobyteHD',id=449b11ec-e586-489d-bddd-d22b13c32479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:37Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f71976df-1439-4f87-b559-83c4ee6e5bcb),volume_type_id=f71976df-1439-4f87-b559-83c4ee6e5bcb)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec7789-173f-4040-a35c-9fbfd798d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec7789-173f-4040-a35c-9fbfd798d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409c150e-1a18-4d79-b190-d6fe99e9ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409c150e-1a18-4d79-b190-d6fe99e9ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449b11ec-e586-489d-bddd-d22b13c32479', 'volume_name': 'volume-449b11ec-e586-489d-bddd-d22b13c32479', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a6d520-4f4b-44e0-bf80-3b575c4b5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:37 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45
Sep 25 17:05:37 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a6d520-4f4b-44e0-bf80-3b575c4b5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd704f9-15b1-4765-9386-c2aa47d62ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Volume 449b11ec-e586-489d-bddd-d22b13c32479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449b11ec-e586-489d-bddd-d22b13c32479', 'volume_size': 1}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,created_at=2026-09-25T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-197174838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,host='devstack@QuobyteHD#QuobyteHD',id=449b11ec-e586-489d-bddd-d22b13c32479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:37Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f71976df-1439-4f87-b559-83c4ee6e5bcb),volume_type_id=f71976df-1439-4f87-b559-83c4ee6e5bcb)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Creating volume 449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:05:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:37 devstack sudo[94528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 1073741824
Sep 25 17:05:37 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:37 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45" returned: 0 in 0.751s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:38 devstack sudo[94539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45
Sep 25 17:05:38 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:38 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 1073741824" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:38 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479
Sep 25 17:05:38 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:38 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1bb898f4-dd5d-445a-aa99-6aab6d923d45" returned: 0 in 0.494s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-1bb898f4-dd5d-445a-aa99-6aab6d923d45" released by "delete_volume" :: held 1.360s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Created reservations ['48b22f4c-edeb-40ce-9c09-0456eb2bca0a', 'cabfe391-9dc7-481b-b9ba-4557a078944d', '89ff8128-754d-42b4-8900-ff05e59b49cd', 'd3e669e9-5df2-4d53-8915-81a48b72daf3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:39 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479" returned: 0 in 0.633s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:39 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:39 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd704f9-15b1-4765-9386-c2aa47d62ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449b11ec-e586-489d-bddd-d22b13c32479', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666c99-1dec-4cc0-854b-b27781a028dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Volume volume-449b11ec-e586-489d-bddd-d22b13c32479 (449b11ec-e586-489d-bddd-d22b13c32479): created successfully
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666c99-1dec-4cc0-854b-b27781a028dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (fd8c5c7c-838d-456c-bc4f-1ebda2cff107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-836b1dd5-ac43-433d-b8d3-7d2de0f47005 tempest-GroupSnapshotsTest-1471183822 None] Created volume successfully.
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-2c80e863-09e1-4bbf-b6dc-250885854929-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:39 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.573s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Deleted volume successfully.
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-2c80e863-09e1-4bbf-b6dc-250885854929-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5a6a34ba-0155-48cd-ac49-22d54b20e96f tempest-VolumesCloneTest-1257502163 None] Lock "cinder-1bb898f4-dd5d-445a-aa99-6aab6d923d45-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "cinder-quobyte-2c80e863-09e1-4bbf-b6dc-250885854929" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-2c80e863-09e1-4bbf-b6dc-250885854929" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf4878-9edb-4ba0-8109-144bd662550e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:40 devstack sudo[94587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:40 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:40 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.830s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:40 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929
Sep 25 17:05:40 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:41 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (d4e2b36a-ab2b-4950-9611-44b9f6e47335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4a3015-0772-43b4-8dcd-2aa630e79eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2c80e863-09e1-4bbf-b6dc-250885854929" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4a3015-0772-43b4-8dcd-2aa630e79eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1949892252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,host='devstack@QuobyteHD#QuobyteHD',id=e65d6586-0380-4008-ad11-86bcb18b37c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:41Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f71976df-1439-4f87-b559-83c4ee6e5bcb),volume_type_id=f71976df-1439-4f87-b559-83c4ee6e5bcb)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cb8921-f4b2-4003-99ef-946815392ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4cb8921-f4b2-4003-99ef-946815392ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385da5c4-61b8-4ee6-b3b8-9570068be43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385da5c4-61b8-4ee6-b3b8-9570068be43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65d6586-0380-4008-ad11-86bcb18b37c2', 'volume_name': 'volume-e65d6586-0380-4008-ad11-86bcb18b37c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bf81c0-611e-48d9-b91b-a9d2b9c7304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bf81c0-611e-48d9-b91b-a9d2b9c7304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864fde38-6a67-49dd-b364-604df6f8c664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Volume e65d6586-0380-4008-ad11-86bcb18b37c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65d6586-0380-4008-ad11-86bcb18b37c2', 'volume_size': 1}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,created_at=2026-09-25T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1949892252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2df7752-8b6e-4a40-bd96-89d9e78c7cf9,host='devstack@QuobyteHD#QuobyteHD',id=e65d6586-0380-4008-ad11-86bcb18b37c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:41Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f71976df-1439-4f87-b559-83c4ee6e5bcb),volume_type_id=f71976df-1439-4f87-b559-83c4ee6e5bcb)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Creating volume e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:41 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-quobyte-2c80e863-09e1-4bbf-b6dc-250885854929" released by "delete_volume" :: held 1.719s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:41 devstack sudo[94620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 1073741824
Sep 25 17:05:41 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-7a637fe0-40b5-4abd-81b0-915ae8badd78 tempest-ServerActionsTestOtherA-1511814876 None] Terminate volume connection completed successfully.
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-7a637fe0-40b5-4abd-81b0-915ae8badd78 tempest-ServerActionsTestOtherA-1511814876 None] Deleting attachment ad6448f9-4d0a-4c0e-9166-d710de7da4cc. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Created reservations ['0d15f5c9-13af-4227-8952-d6f960d98d20', '2004472e-cbae-4755-8320-d1dfd31d7449', 'c43860f2-12cb-4856-85cc-700d4d57f765', '35262b6f-fef7-49bd-a90f-5aee41ef8618'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:41 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:41 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "cinder-29e3c87e-60f1-4fb5-88ff-5fd690129323-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-29e3c87e-60f1-4fb5-88ff-5fd690129323-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "cinder-quobyte-29e3c87e-60f1-4fb5-88ff-5fd690129323" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-quobyte-29e3c87e-60f1-4fb5-88ff-5fd690129323" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4746213-2660-40a2-a33b-ca2b0b6fab9f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:42 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323
Sep 25 17:05:42 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 1073741824" returned: 0 in 0.747s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:42 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:42 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:42 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2
Sep 25 17:05:42 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Deleted volume successfully.
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9dbb6b5d-ee19-493e-9a49-1cf7643557b9 tempest-VolumesCloneTest-1257502163 None] Lock "cinder-2c80e863-09e1-4bbf-b6dc-250885854929-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:42 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:42 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323
Sep 25 17:05:42 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:42 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2" returned: 0 in 0.576s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864fde38-6a67-49dd-b364-604df6f8c664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65d6586-0380-4008-ad11-86bcb18b37c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ea7c63-d13d-4ac5-8850-3192b652fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Volume volume-e65d6586-0380-4008-ad11-86bcb18b37c2 (e65d6586-0380-4008-ad11-86bcb18b37c2): created successfully
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ea7c63-d13d-4ac5-8850-3192b652fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (d4e2b36a-ab2b-4950-9611-44b9f6e47335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8ccecc74-e88a-4eac-a5c4-f47780074b19 tempest-GroupSnapshotsTest-1471183822 None] Created volume successfully.
Sep 25 17:05:43 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-29e3c87e-60f1-4fb5-88ff-5fd690129323" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-quobyte-29e3c87e-60f1-4fb5-88ff-5fd690129323" released by "delete_volume" :: held 1.216s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.quota [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Created reservations ['ec6ef33c-e78f-45cd-989a-aedb9aeb4f86', 'f2682a07-ad6e-4e50-ac43-e74b0ee7b721', 'bd52af39-e714-4264-b972-fac8f8b5c2f4', 'd1817e37-44b2-4d4e-bd38-b3a2adfc63e7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:43 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:43 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:43 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.manager [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Deleted volume successfully.
Sep 25 17:05:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-10f5042c-07aa-4ba9-b859-1740aa48f02a req-b945bad5-3665-4210-b4ab-082dbe36c87b tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-29e3c87e-60f1-4fb5-88ff-5fd690129323-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1d693f8d-1d30-4f0b-aecb-c11013083f4f tempest-GroupSnapshotsTest-1471183822 None] Update group completed successfully.
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "cinder-0a12882d-786b-4f3a-a9e2-14224ed6ee07-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-0a12882d-786b-4f3a-a9e2-14224ed6ee07-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "cinder-quobyte-0a12882d-786b-4f3a-a9e2-14224ed6ee07" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-quobyte-0a12882d-786b-4f3a-a9e2-14224ed6ee07" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacd9e9-818d-48d5-b0d6-5e4d70078e8e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:44 devstack sudo[94644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07
Sep 25 17:05:44 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:45 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07" returned: 0 in 0.519s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:45 devstack sudo[94649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07
Sep 25 17:05:45 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-71d399c5-d765-4873-87fb-bccb7e445e55 tempest-GroupSnapshotsTest-1471183822 None] Update group completed successfully.
Sep 25 17:05:45 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0a12882d-786b-4f3a-a9e2-14224ed6ee07" returned: 0 in 0.550s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-quobyte-0a12882d-786b-4f3a-a9e2-14224ed6ee07" released by "delete_volume" :: held 1.196s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Created reservations ['67836de8-b440-41e0-8935-080f8cc300fe', 'd6ae1daf-e21e-44f5-9f76-93e6813360d6', 'df003691-4edb-4197-b215-a6bc0a7e5462', '34e68500-3cc2-4682-a148-f386175e4233'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:46 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:05:46 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:46 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.586s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:05:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Deleted volume successfully.
Sep 25 17:05:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-495e7e87-2bcd-4344-94ca-c840abbbbddf tempest-ServerActionsTestOtherA-1511814876 None] Lock "cinder-0a12882d-786b-4f3a-a9e2-14224ed6ee07-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:05:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4380139a-9066-4049-b9f0-42fd5c244193 tempest-GroupSnapshotsTest-1471183822 None] Update group completed successfully.
Sep 25 17:05:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-50a8b077-15c7-4926-9a5d-3fb67d4fa6ff tempest-GroupSnapshotsTest-1471183822 None] Update group completed successfully.
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Flow 'volume_create_manager' (b8fdd616-6cb6-4335-8184-86781e13b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c0890f-7408-4099-b94f-6eaabf601745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c0890f-7408-4099-b94f-6eaabf601745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1089545401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa386ba3-5c58-4625-9a59-44ccd5770f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621ccb697a6c411faed6158e63bb384b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:50Z,use_quota=True,user_id='666ed9d8d90647cf8f18518e32b85e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c4c0b1-d9d3-41e0-a8d3-c48c957c2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c4c0b1-d9d3-41e0-a8d3-c48c957c2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2e42e-7c34-42e3-86d0-bbcf279933a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:05:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] GroupSnapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: creating.
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Group snapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Creating offline snapshot 78a32e8c-0328-4514-acd4-ba91c334208a of volume 449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd576db6-b718-4084-a7f6-33f8c7d68a79]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:51 devstack sudo[94821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479
Sep 25 17:05:51 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2e42e-7c34-42e3-86d0-bbcf279933a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa386ba3-5c58-4625-9a59-44ccd5770f1d', 'volume_name': 'volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abafda0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb3394a-b535-45e6-86f6-84123f96c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb3394a-b535-45e6-86f6-84123f96c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6de115-711f-4f27-933e-85f26a8e7914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:05:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Volume fa386ba3-5c58-4625-9a59-44ccd5770f1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abafda0>}
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Trying to clone fa386ba3-5c58-4625-9a59-44ccd5770f1d from image 21fcf20c-2aec-48a7-986a-08b11deee77e at location (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:05:51 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479" returned: 0 in 0.919s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:51 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a 1G
Sep 25 17:05:51 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:52 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:05:52 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 17:05:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1f7a6e-f1c1-423e-b320-387a9a0cc22e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:52 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD
Sep 25 17:05:52 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:53 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a 1G" returned: 0 in 1.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b11ec-e586-489d-bddd-d22b13c32479 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:53 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b11ec-e586-489d-bddd-d22b13c32479 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a
Sep 25 17:05:53 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:53 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e is fetched for user 666ed9d8d90647cf8f18518e32b85e42. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a8aa82-1d80-48f1-a9f7-23bb6a8f6678]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:53 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD
Sep 25 17:05:53 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:53 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449b11ec-e586-489d-bddd-d22b13c32479 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a" returned: 0 in 0.635s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:53 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:53 devstack sudo[94848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a
Sep 25 17:05:53 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:54 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:54 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a" returned: 0 in 0.386s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:54 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info
Sep 25 17:05:54 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:54 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info" returned: 0 in 0.373s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:54 devstack sudo[94861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info
Sep 25 17:05:54 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:54 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.info" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Creating offline snapshot db40a49d-5318-4c63-b433-af578afb0b86 of volume e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafaaea-670e-4d0f-8c3d-8113961df0a6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:55 devstack sudo[94872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2
Sep 25 17:05:55 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:55 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2" returned: 0 in 0.554s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:55 devstack sudo[94886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 1G
Sep 25 17:05:55 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:56 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 1G" returned: 0 in 0.566s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65d6586-0380-4008-ad11-86bcb18b37c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:56 devstack sudo[94903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65d6586-0380-4008-ad11-86bcb18b37c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86
Sep 25 17:05:56 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:56 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e65d6586-0380-4008-ad11-86bcb18b37c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86" returned: 0 in 0.418s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:56 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:56 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86
Sep 25 17:05:56 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:56 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86" returned: 0 in 0.255s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:56 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info
Sep 25 17:05:56 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:57 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info" returned: 0 in 0.453s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:57 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:57 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info
Sep 25 17:05:57 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:57 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.info" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1089545401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa386ba3-5c58-4625-9a59-44ccd5770f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621ccb697a6c411faed6158e63bb384b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:50Z,use_quota=True,user_id='666ed9d8d90647cf8f18518e32b85e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Creating volume fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:05:57 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:05:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:57 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1073741824
Sep 25 17:05:57 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dbf5b56b-1722-4fa0-85f4-fa6014be6fbb tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: created successfully
Sep 25 17:05:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: deleting
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 17:05:58 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1073741824" returned: 0 in 0.911s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-78a32e8c-0328-4514-acd4-ba91c334208a" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-78a32e8c-0328-4514-acd4-ba91c334208a" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:05:58 devstack sudo[94947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Deleting offline snapshot 78a32e8c-0328-4514-acd4-ba91c334208a of volume 449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:05:58 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] snapshot_file for this snap is: volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[329958e9-402c-4d3f-87b7-6f8ed14b79d7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:59 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a
Sep 25 17:05:59 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:59 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d" returned: 0 in 0.546s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Attempting download of 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume fa386ba3-5c58-4625-9a59-44ccd5770f1d. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3851e8-3994-49d6-bec8-918482501db6]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:05:59 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:05:59 devstack sudo[94954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg
Sep 25 17:05:59 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-449b11ec-e586-489d-bddd-d22b13c32479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f328057-e892-4b11-8100-c25689ac2ee6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:05:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:00 devstack sudo[94957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479
Sep 25 17:06:00 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:00 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg" returned: 0 in 0.753s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:00 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg
Sep 25 17:06:00 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Flow 'volume_create_manager' (a50ae85a-fa30-4e6a-8020-5e87ac6b7c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b605bb89-008c-4dd9-b9dd-9528c71ef354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b605bb89-008c-4dd9-b9dd-9528c71ef354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-892982271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c286693-2899-4150-a66e-a162c4c18b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654922c1ce7646b3a8fc9ac2bd5894f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:01Z,use_quota=True,user_id='39a67571189746329713e876bdfbf7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c0558e-e829-4ef9-8bb4-0ce2ed9adaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c0558e-e829-4ef9-8bb4-0ce2ed9adaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d54ca9-9340-428a-8fd1-cd13c0133e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d54ca9-9340-428a-8fd1-cd13c0133e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c286693-2899-4150-a66e-a162c4c18b8e', 'volume_name': 'volume-7c286693-2899-4150-a66e-a162c4c18b8e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bf68a2-b2c0-401d-9fc4-8282414d018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bf68a2-b2c0-401d-9fc4-8282414d018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09aa5c17-0467-44a5-ae80-3c0693228358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Volume 7c286693-2899-4150-a66e-a162c4c18b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c286693-2899-4150-a66e-a162c4c18b8e', 'volume_size': 1}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-892982271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c286693-2899-4150-a66e-a162c4c18b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654922c1ce7646b3a8fc9ac2bd5894f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:01Z,use_quota=True,user_id='39a67571189746329713e876bdfbf7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Creating volume 7c286693-2899-4150-a66e-a162c4c18b8e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:06:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:00 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479" returned: 0 in 1.117s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:00 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a
Sep 25 17:06:00 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:01 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e 1073741824
Sep 25 17:06:01 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:01 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg" returned: 1 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_06ahsidg' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3644f333-e2a0-4aa7-8c6f-603ad520e0bd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:01 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD
Sep 25 17:06:01 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:01 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:01 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a
Sep 25 17:06:01 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:02 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD" returned: 0 in 0.951s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] 21fcf20c-2aec-48a7-986a-08b11deee77e was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:02 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e 1073741824" returned: 0 in 1.166s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:02 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d
Sep 25 17:06:02 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:02 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e
Sep 25 17:06:02 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:02 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479.78a32e8c-0328-4514-acd4-ba91c334208a" returned: 0 in 0.733s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-78a32e8c-0328-4514-acd4-ba91c334208a" released by "_delete_snapshot" :: held 3.774s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" released by "delete_snapshot" :: held 3.841s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-db40a49d-5318-4c63-b433-af578afb0b86" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-db40a49d-5318-4c63-b433-af578afb0b86" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Deleting offline snapshot db40a49d-5318-4c63-b433-af578afb0b86 of volume e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] snapshot_file for this snap is: volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819420d-27e0-48cb-8e88-a32352d15f5f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:02 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e" returned: 0 in 0.621s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09aa5c17-0467-44a5-ae80-3c0693228358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c286693-2899-4150-a66e-a162c4c18b8e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97293f3-e758-46eb-82cb-18d6b9ba0df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Volume volume-7c286693-2899-4150-a66e-a162c4c18b8e (7c286693-2899-4150-a66e-a162c4c18b8e): created successfully
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97293f3-e758-46eb-82cb-18d6b9ba0df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Flow 'volume_create_manager' (a50ae85a-fa30-4e6a-8020-5e87ac6b7c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:02 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86
Sep 25 17:06:02 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7ef83573-9e67-4bc5-99cf-364cdefa06a6 tempest-ServerRescueNegativeTestJSON-248288920 None] Created volume successfully.
Sep 25 17:06:03 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86" returned: 0 in 0.716s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e65d6586-0380-4008-ad11-86bcb18b37c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881cccf-6321-4956-ae73-9a0a00b25a14]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:03 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:03 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:03 devstack sudo[95006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2
Sep 25 17:06:03 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:04 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.814s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:04 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2" returned: 0 in 0.943s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:04 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86
Sep 25 17:06:04 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:05 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86" returned: 0 in 0.808s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:05 devstack sudo[95024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86
Sep 25 17:06:05 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:05 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d" returned: 0 in 3.350s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e__jme__2_devstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:06:05 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Converted 112.00 MB image at 33.40 MB/s
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:05 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1G
Sep 25 17:06:05 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:05 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2.db40a49d-5318-4c63-b433-af578afb0b86" returned: 0 in 0.467s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-db40a49d-5318-4c63-b433-af578afb0b86" released by "_delete_snapshot" :: held 3.110s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" released by "delete_snapshot" :: held 3.162s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:05 devstack cinder-volume[86955]: WARNING cinder.quota [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1243260541 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1243260541, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:05 devstack cinder-volume[86955]: WARNING cinder.quota [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1243260541 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1243260541, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:05 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['d5709e4e-da42-4c22-8c0d-351fa554bb5e', '4e3b3c39-69ff-43b5-8dcc-67a259aa8f4d', '2c564431-c831-4fad-bf92-7a29c1a64a59', '7ae3ad91-6a4b-49e7-b46c-c8d555f6baf6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['49feece8-ba49-48cb-bea4-2ded56335179', 'e721e18c-2061-4c26-af7a-08d313d9e9fc', '97732119-0c3f-4185-980a-46dd69754b05', 'c21b1959-5fc2-4a25-9a1c-4ba037977e35'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:06 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 1G" returned: 0 in 0.905s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Downloaded image 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume fa386ba3-5c58-4625-9a59-44ccd5770f1d successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e for user 666ed9d8d90647cf8f18518e32b85e42 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Marking volume fa386ba3-5c58-4625-9a59-44ccd5770f1d as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:06:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0ff577bd-98dd-4dd8-af60-d56dc20a8aee tempest-GroupSnapshotsTest-1471183822 None] group_snapshot 2cb60678-cd3e-46da-91da-8fa09c4e7e1a: deleted successfully
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Copying metadata from image 21fcf20c-2aec-48a7-986a-08b11deee77e to fa386ba3-5c58-4625-9a59-44ccd5770f1d. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Creating volume glance metadata for volume fa386ba3-5c58-4625-9a59-44ccd5770f1d backed by image 21fcf20c-2aec-48a7-986a-08b11deee77e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6de115-711f-4f27-933e-85f26a8e7914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abafda0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab0e61d-3f2c-436f-aa5f-13503e20134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Volume volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d (fa386ba3-5c58-4625-9a59-44ccd5770f1d): created successfully
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab0e61d-3f2c-436f-aa5f-13503e20134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Flow 'volume_create_manager' (b8fdd616-6cb6-4335-8184-86781e13b610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4a38534e-e0ea-40b4-9207-cbfafd46d0ec tempest-VolumesExtendTest-102043707 None] Created volume successfully.
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd7b72-04d2-46fa-9803-7bc134b87a7c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:07 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479
Sep 25 17:06:07 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2d9d4-1346-4b5d-a8c9-8382cc7ba431]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:07 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:08 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d
Sep 25 17:06:08 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:08 devstack sudo[95073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479
Sep 25 17:06:08 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:08 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-449b11ec-e586-489d-bddd-d22b13c32479" returned: 0 in 0.602s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-449b11ec-e586-489d-bddd-d22b13c32479" released by "delete_volume" :: held 1.439s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:08 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d" returned: 0 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" acquired by "delete_volume" :: waited 0.067s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d977f4c-a444-4faa-8ab5-e7b859326309]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d 2G" returned: 0 in 0.212s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.108s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aee2829c-910a-431c-88ef-8c7acebf3264 tempest-VolumesExtendTest-102043707 None] Extend volume completed successfully.
Sep 25 17:06:08 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2
Sep 25 17:06:08 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:09 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2" returned: 0 in 0.632s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:09 devstack sudo[95104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2
Sep 25 17:06:09 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:09 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e65d6586-0380-4008-ad11-86bcb18b37c2" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-e65d6586-0380-4008-ad11-86bcb18b37c2" released by "delete_volume" :: held 1.150s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['5eb2aa8b-2ef8-4917-8ea0-6415940b8185'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:10 devstack cinder-volume[86955]: WARNING cinder.quota [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1243260541 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1243260541, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['cd61df3b-75b5-403d-a28b-a00091830e0e', 'e0f38318-75ed-48fa-837c-9a84c667aaa8', '700897c0-a203-490c-a18f-d0f8722abec5', '54767e1a-b311-4b46-9840-03679619de28'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['4deb829c-d590-4329-95c0-a08dca1c7770', '84ec64bb-db69-402a-84dc-51282b362844', '38489a88-7fad-4c34-88cf-872239a308a2', '207a5eb8-ff74-4488-8b10-13726f80dc97'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:10 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:10 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-fa386ba3-5c58-4625-9a59-44ccd5770f1d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "cinder-fa386ba3-5c58-4625-9a59-44ccd5770f1d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:10 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.393s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-quobyte-fa386ba3-5c58-4625-9a59-44ccd5770f1d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7daef6df-c8ce-4164-9475-a73eb48409f6 tempest-GroupSnapshotsTest-1471183822 None] Delete group completed successfully.
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-fa386ba3-5c58-4625-9a59-44ccd5770f1d" acquired by "delete_volume" :: waited 0.041s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d3d699-36e8-4be0-9339-fafd44ee3bcb]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:11 devstack sudo[95134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d
Sep 25 17:06:11 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:11 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:11 devstack sudo[95140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d
Sep 25 17:06:11 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:12 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fa386ba3-5c58-4625-9a59-44ccd5770f1d" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-fa386ba3-5c58-4625-9a59-44ccd5770f1d" released by "delete_volume" :: held 1.247s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-999fda4a-6351-499e-b29a-c63a477837b1 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-261733184: creating
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Created reservations ['1a0a849f-f69b-4004-b98e-367c7c89862a', '57a73c93-ced0-49ad-8634-af90b66ad3f2', '44437898-a06f-456c-ae7a-c18bf7bbf460', 'b5b391e4-b4a7-4f95-9b69-0db90c4542b4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-999fda4a-6351-499e-b29a-c63a477837b1 tempest-GroupSnapshotsTest-1471183822 None] Group tempest-GroupSnapshotsTest-Group-261733184: created successfully
Sep 25 17:06:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-999fda4a-6351-499e-b29a-c63a477837b1 tempest-GroupSnapshotsTest-1471183822 None] Create group completed successfully.
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:12 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:12 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:12 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.434s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Deleted volume successfully.
Sep 25 17:06:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f3038456-f39d-4b58-9391-37e6e8839d23 tempest-VolumesExtendTest-102043707 None] Lock "cinder-fa386ba3-5c58-4625-9a59-44ccd5770f1d-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Flow 'volume_create_manager' (9cdec39e-1615-44fc-8039-1adaaad02297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf799e5d-18d9-49f5-8aa5-3ace993e1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf799e5d-18d9-49f5-8aa5-3ace993e1439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1932004449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6ec042-fb4a-4a2b-a80d-c06d144703e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621ccb697a6c411faed6158e63bb384b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:15Z,use_quota=True,user_id='666ed9d8d90647cf8f18518e32b85e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b1695-9677-4742-bb48-442f8cf8ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b1695-9677-4742-bb48-442f8cf8ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eecf468-a82b-4956-9056-e13768b8abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eecf468-a82b-4956-9056-e13768b8abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6ec042-fb4a-4a2b-a80d-c06d144703e4', 'volume_name': 'volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f64713-a110-43f2-b984-6b4f17cd4087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f64713-a110-43f2-b984-6b4f17cd4087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6ee01b-e2be-4d37-9390-d5916d9ae045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Volume 4b6ec042-fb4a-4a2b-a80d-c06d144703e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4', 'volume_size': 1}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1932004449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6ec042-fb4a-4a2b-a80d-c06d144703e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621ccb697a6c411faed6158e63bb384b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:15Z,use_quota=True,user_id='666ed9d8d90647cf8f18518e32b85e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Creating volume 4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:06:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:14 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 1073741824
Sep 25 17:06:14 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (c1a71d1d-413d-4ea8-85af-d465e04112d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da116f96-314b-4118-b764-02fe1d4bdd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da116f96-314b-4118-b764-02fe1d4bdd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583607266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fd22c09-7aca-4840-a592-5768537af64e,host='devstack@QuobyteHD#QuobyteHD',id=8a343366-afcb-47d5-ae6a-b822e09c71f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:15Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9536db05-386b-491a-9081-e15971d25133),volume_type_id=9536db05-386b-491a-9081-e15971d25133)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc488a06-c765-44ae-9202-62b30fb846df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc488a06-c765-44ae-9202-62b30fb846df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb63fc7-1b02-4bdc-af05-fd7def35c44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb63fc7-1b02-4bdc-af05-fd7def35c44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a343366-afcb-47d5-ae6a-b822e09c71f4', 'volume_name': 'volume-8a343366-afcb-47d5-ae6a-b822e09c71f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c72d86-836c-42cb-a972-954d3d7a9c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c72d86-836c-42cb-a972-954d3d7a9c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afbc8b7-b2a9-4cdd-a45b-1d47a8b29d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Volume 8a343366-afcb-47d5-ae6a-b822e09c71f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a343366-afcb-47d5-ae6a-b822e09c71f4', 'volume_size': 1}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:15 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 1073741824" returned: 0 in 0.724s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:15 devstack sudo[95216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:15 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:15 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6fd22c09-7aca-4840-a592-5768537af64e,created_at=2026-09-25T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583607266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fd22c09-7aca-4840-a592-5768537af64e,host='devstack@QuobyteHD#QuobyteHD',id=8a343366-afcb-47d5-ae6a-b822e09c71f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac753d93b343c4ba1915b4353aa359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:15Z,use_quota=True,user_id='f143d4f0e7f14023a99508b38b4c0d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9536db05-386b-491a-9081-e15971d25133),volume_type_id=9536db05-386b-491a-9081-e15971d25133)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Creating volume 8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:06:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:16 devstack sudo[95220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 1073741824
Sep 25 17:06:16 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6ee01b-e2be-4d37-9390-d5916d9ae045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66906a79-a757-4d49-b713-b768e6c83ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Volume volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 (4b6ec042-fb4a-4a2b-a80d-c06d144703e4): created successfully
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66906a79-a757-4d49-b713-b768e6c83ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Flow 'volume_create_manager' (9cdec39e-1615-44fc-8039-1adaaad02297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-db6fb22d-b02f-4366-9e6c-60746eea1a4c tempest-VolumesExtendTest-102043707 None] Created volume successfully.
Sep 25 17:06:16 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 1073741824" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:16 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4
Sep 25 17:06:16 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:17 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.271s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afbc8b7-b2a9-4cdd-a45b-1d47a8b29d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a343366-afcb-47d5-ae6a-b822e09c71f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa44ee8-0338-405f-8af4-75f0b0d9d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Creating offline snapshot 67da49f4-9fc1-480f-a678-6b9978ec7bc5 of volume 4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:06:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Volume volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 (8a343366-afcb-47d5-ae6a-b822e09c71f4): created successfully
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa44ee8-0338-405f-8af4-75f0b0d9d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Flow 'volume_create_manager' (c1a71d1d-413d-4ea8-85af-d465e04112d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a86cf5-1f0a-4ca4-9d7a-7de447e7c222]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-30669759-26dc-4b11-8ad2-1b6d81d6ca02 tempest-GroupSnapshotsTest-1471183822 None] Created volume successfully.
Sep 25 17:06:17 devstack sudo[95258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:17 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:17 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.446s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:17 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 1G
Sep 25 17:06:17 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:18 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 1G" returned: 0 in 0.562s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:18 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5
Sep 25 17:06:18 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:18 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 is being set with open permissions: ugo+rw
Sep 25 17:06:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:18 devstack sudo[95290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5
Sep 25 17:06:18 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] GroupSnapshot d9b63714-c53f-48e2-b137-6931ace90ae6: creating.
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Group snapshot d9b63714-c53f-48e2-b137-6931ace90ae6: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:19 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5" returned: 0 in 0.417s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:19 devstack sudo[95293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info
Sep 25 17:06:19 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:19 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info" returned: 0 in 0.521s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:19 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info is being set with open permissions: ugo+rw
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:19 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info
Sep 25 17:06:19 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Acquiring lock "cinder-7c286693-2899-4150-a66e-a162c4c18b8e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "cinder-7c286693-2899-4150-a66e-a162c4c18b8e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=123,cinder:INSERT=39,cinder:UPDATE=132,cinder:DELETE=9 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=144,cinder:SELECT=129,cinder:INSERT=38,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Acquiring lock "cinder-quobyte-7c286693-2899-4150-a66e-a162c4c18b8e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "cinder-quobyte-7c286693-2899-4150-a66e-a162c4c18b8e" acquired by "delete_volume" :: waited 0.054s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4501e-3b9f-48b0-b275-bdc715236e47]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:20 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.info" returned: 0 in 0.544s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:20 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e
Sep 25 17:06:20 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.180s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.279s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Creating offline snapshot a04d074c-093c-4aad-b850-0828b3237758 of volume 8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:06:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4bd0630b-be31-48f8-861d-66d1361a3f6d tempest-VolumesExtendTest-102043707 None] Create snapshot completed successfully
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd110f27-9d58-46b9-b966-ee60e27203fc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:20 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4
Sep 25 17:06:20 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:20 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:20 devstack sudo[95308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e
Sep 25 17:06:20 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:21 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4" returned: 0 in 0.673s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:21 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 1G
Sep 25 17:06:21 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:21 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c286693-2899-4150-a66e-a162c4c18b8e" returned: 0 in 0.534s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "cinder-quobyte-7c286693-2899-4150-a66e-a162c4c18b8e" released by "delete_volume" :: held 1.314s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Created reservations ['195c8045-3d28-43ef-bdfb-2185c0998e24', '6a1b4d6a-f58f-430c-8924-cedef94453b4', '584960a0-757a-45d5-a95d-03f34580f2d8', 'e2a4b1cb-1a6a-4b0b-9922-f27911a7ea25'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:21 devstack sudo[95316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:21 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:22 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 1G" returned: 0 in 0.918s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:22 devstack sudo[95322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758
Sep 25 17:06:22 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:22 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Deleted volume successfully.
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-093caa05-f8cc-4d9d-8588-3149de5b624b tempest-ServerRescueNegativeTestJSON-248288920 None] Lock "cinder-7c286693-2899-4150-a66e-a162c4c18b8e-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:22 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758" returned: 0 in 0.540s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:22 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:06:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:22 devstack sudo[95329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758
Sep 25 17:06:22 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:23 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758" returned: 0 in 0.486s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:23 devstack sudo[95337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info
Sep 25 17:06:23 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:23 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info" returned: 0 in 0.601s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:06:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:23 devstack sudo[95362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info
Sep 25 17:06:23 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:24 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.info" returned: 0 in 0.588s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.763s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80f2d4-3692-42f0-a837-90bff00e487e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c9834503-309c-4c1c-8236-453b886689a7 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot d9b63714-c53f-48e2-b137-6931ace90ae6: created successfully
Sep 25 17:06:24 devstack sudo[95381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:24 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot d9b63714-c53f-48e2-b137-6931ace90ae6: deleting
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot d9b63714-c53f-48e2-b137-6931ace90ae6: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-a04d074c-093c-4aad-b850-0828b3237758" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-a04d074c-093c-4aad-b850-0828b3237758" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Deleting offline snapshot a04d074c-093c-4aad-b850-0828b3237758 of volume 8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] snapshot_file for this snap is: volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a340b-dc1d-4fd6-9092-e873be594280]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:25 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.991s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:25 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758
Sep 25 17:06:25 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 2G" returned: 0 in 0.412s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.530s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-17f2fe64-6b35-4244-a730-f1e12675c748 tempest-VolumesExtendTest-102043707 None] Extend volume completed successfully.
Sep 25 17:06:26 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758" returned: 0 in 0.927s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a343366-afcb-47d5-ae6a-b822e09c71f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe452c-d0b8-4f89-a328-ae42a7ce1d7d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:26 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4
Sep 25 17:06:26 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-67da49f4-9fc1-480f-a678-6b9978ec7bc5-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-67da49f4-9fc1-480f-a678-6b9978ec7bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-quobyte-67da49f4-9fc1-480f-a678-6b9978ec7bc5" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-67da49f4-9fc1-480f-a678-6b9978ec7bc5" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Deleting offline snapshot 67da49f4-9fc1-480f-a678-6b9978ec7bc5 of volume 4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] snapshot_file for this snap is: volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885d736-a644-43c6-a674-8c5c1faa6869]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:26 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4" returned: 0 in 0.659s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:27 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758
Sep 25 17:06:27 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:27 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5
Sep 25 17:06:27 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:27 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:27 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5" returned: 0 in 0.552s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758" returned: 0 in 0.431s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c952a-401a-4774-b5a6-cbdcce74d976]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:27 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758
Sep 25 17:06:27 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:27 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:27 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:27 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4.a04d074c-093c-4aad-b850-0828b3237758" returned: 0 in 0.311s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-a04d074c-093c-4aad-b850-0828b3237758" released by "_delete_snapshot" :: held 2.530s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" released by "delete_snapshot" :: held 2.590s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:27 devstack cinder-volume[86955]: WARNING cinder.quota [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-479920530 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-479920530, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:27 devstack cinder-volume[86955]: WARNING cinder.quota [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-479920530 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-479920530, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['1c99641f-e0cd-4e97-82fd-71b856cc63b2', '7080386b-7b6a-440e-83b8-eb45f1ffd852', 'b5b5df6e-9db1-4adc-8f60-d1a5c4b01093', '83bbcbf6-e1a4-4747-ba34-369145903d4f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:27 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.491s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:27 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5
Sep 25 17:06:27 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cd731fa0-295d-47e1-a0f2-1b21977f7eb7 tempest-GroupSnapshotsTest-1471183822 None] group_snapshot d9b63714-c53f-48e2-b137-6931ace90ae6: deleted successfully
Sep 25 17:06:28 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5" returned: 0 in 0.590s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:28 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5
Sep 25 17:06:28 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:28 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4.67da49f4-9fc1-480f-a678-6b9978ec7bc5" returned: 0 in 0.413s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-67da49f4-9fc1-480f-a678-6b9978ec7bc5" released by "_delete_snapshot" :: held 2.283s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" released by "delete_snapshot" :: held 2.343s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Created reservations ['39e9a114-464b-4d81-8068-d9c029fa43c0', '55f7bd0c-39d8-4ae8-853a-7b5da5b3a851', 'c4148611-ac96-4200-9b9b-1ae573073a6e', '94188458-c4f8-4e62-b797-57dcd5dc0515'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e34c5-116a-4268-8903-790f52dfc6f2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Delete snapshot completed successfully.
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22575c3a-a6a1-4efe-83eb-1841450dac29 tempest-VolumesExtendTest-102043707 None] Lock "cinder-67da49f4-9fc1-480f-a678-6b9978ec7bc5-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:29 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4
Sep 25 17:06:29 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:29 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4" returned: 0 in 0.510s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:29 devstack sudo[95484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4
Sep 25 17:06:29 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-4b6ec042-fb4a-4a2b-a80d-c06d144703e4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "cinder-4b6ec042-fb4a-4a2b-a80d-c06d144703e4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Acquiring lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:30 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c96ae-03cc-46d3-bfe5-bb7805a86246]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8a343366-afcb-47d5-ae6a-b822e09c71f4" returned: 0 in 0.428s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Lock "cinder-quobyte-8a343366-afcb-47d5-ae6a-b822e09c71f4" released by "delete_volume" :: held 1.040s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['d76f49a9-033d-487d-acf5-3d64bad53a92'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:30 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:30 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:30 devstack cinder-volume[86955]: WARNING cinder.quota [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-479920530 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-479920530, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Created reservations ['e0b27ee4-d9e8-4fcc-916e-4305dbcc0f6b', '249b3d9e-da6b-4f14-9921-3c1641fdc279', '8a2f243f-ed30-4eaa-b67f-66d4a209092e', '164b6ae9-a304-4986-9b52-caa2f4c7cc5a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:30 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:30 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:30 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.708s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:31 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4
Sep 25 17:06:31 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:31 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6b6ce71d-3af2-4472-bfa7-6c4c567c5936 tempest-GroupSnapshotsTest-1471183822 None] Delete group completed successfully.
Sep 25 17:06:31 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" returned: 0 in 0.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "cinder-quobyte-4b6ec042-fb4a-4a2b-a80d-c06d144703e4" released by "delete_volume" :: held 1.152s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Created reservations ['4e670a21-1f4d-42fa-8d23-49d3a6bce127', 'd416f355-f0ac-4112-9ee5-5a2f747566c7', '67286c76-0a50-47c7-a4a2-f92528023346', 'f6f4c931-c76c-4424-8ea5-f0dd5f2fe60d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:31 devstack sudo[95516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:31 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:31 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.313s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Deleted volume successfully.
Sep 25 17:06:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-758b6305-dd98-4059-bb58-4f9f1dd90afd tempest-VolumesExtendTest-102043707 None] Lock "cinder-4b6ec042-fb4a-4a2b-a80d-c06d144703e4-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:41 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=33,cinder:DELETE=2,cinder:INSERT=14,cinder:UPDATE=41 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:06:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d27a6362-5819-4c35-adc6-27da1ab813d0 tempest-GroupSnapshotsV319Test-2105085334 None] Group tempest-GroupSnapshotsV319Test-Group-685827454: creating
Sep 25 17:06:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d27a6362-5819-4c35-adc6-27da1ab813d0 tempest-GroupSnapshotsV319Test-2105085334 None] Group tempest-GroupSnapshotsV319Test-Group-685827454: created successfully
Sep 25 17:06:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d27a6362-5819-4c35-adc6-27da1ab813d0 tempest-GroupSnapshotsV319Test-2105085334 None] Create group completed successfully.
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Flow 'volume_create_manager' (8fa48366-87bb-44ed-8f81-bd18356f102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f190a7bc-850d-4e03-a034-8684e22f0197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f190a7bc-850d-4e03-a034-8684e22f0197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376499680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27915222-6bef-42fb-aa79-866bcc4ae431,host='devstack@QuobyteHD#QuobyteHD',id=488a690c-2bd5-46b1-8cb2-59ef3c58689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a90c49af8442b284afcee9e886d339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:44Z,use_quota=True,user_id='e69ac4ddfe3a43b5aba37682a3d6af65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(240a19e4-fa33-4879-b9b3-c88e6cb48d96),volume_type_id=240a19e4-fa33-4879-b9b3-c88e6cb48d96)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea66d41-5cf1-4373-ac23-39985770f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea66d41-5cf1-4373-ac23-39985770f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c4731e-91a0-4189-850a-06f76edf3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c4731e-91a0-4189-850a-06f76edf3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488a690c-2bd5-46b1-8cb2-59ef3c58689d', 'volume_name': 'volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2325f-3b9b-4388-afcf-1a0465d0494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f2325f-3b9b-4388-afcf-1a0465d0494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d55db1-8469-48ce-8290-19c2bbac75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Volume 488a690c-2bd5-46b1-8cb2-59ef3c58689d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d', 'volume_size': 1}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=27915222-6bef-42fb-aa79-866bcc4ae431,created_at=2026-09-25T15:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376499680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27915222-6bef-42fb-aa79-866bcc4ae431,host='devstack@QuobyteHD#QuobyteHD',id=488a690c-2bd5-46b1-8cb2-59ef3c58689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a90c49af8442b284afcee9e886d339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:44Z,use_quota=True,user_id='e69ac4ddfe3a43b5aba37682a3d6af65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(240a19e4-fa33-4879-b9b3-c88e6cb48d96),volume_type_id=240a19e4-fa33-4879-b9b3-c88e6cb48d96)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Creating volume 488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:06:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:44 devstack sudo[95619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d 1073741824
Sep 25 17:06:44 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:44 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d 1073741824" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:45 devstack sudo[95624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d
Sep 25 17:06:45 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:45 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d" returned: 0 in 0.410s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d55db1-8469-48ce-8290-19c2bbac75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232d375e-66b4-4aa2-a6d2-060cc61b7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Volume volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d (488a690c-2bd5-46b1-8cb2-59ef3c58689d): created successfully
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232d375e-66b4-4aa2-a6d2-060cc61b7f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Flow 'volume_create_manager' (8fa48366-87bb-44ed-8f81-bd18356f102c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0c85c904-a2c5-49a4-bb23-13b2ffaaed3f tempest-GroupSnapshotsV319Test-2105085334 None] Created volume successfully.
Sep 25 17:06:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0d970827-2b16-40a2-93e7-264fa6004c46 tempest-BackendsCapabilitiesAdminTestsJSON-371301090 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 17:06:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6751de99-9349-4fce-80bd-ac927e8de725 tempest-BackendsCapabilitiesAdminTestsJSON-371301090 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 17:06:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] GroupSnapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: creating.
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Group snapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Creating offline snapshot 0b786f96-1627-4baa-b2f9-2b559de1fc5c of volume 488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01aa0e-a881-4c45-8e02-ae2a3d59e06b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:47 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d
Sep 25 17:06:47 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:48 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:48 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c 1G
Sep 25 17:06:48 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:48 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c 1G" returned: 0 in 0.717s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:48 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c
Sep 25 17:06:48 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:49 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c" returned: 0 in 0.399s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:49 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:06:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:49 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c
Sep 25 17:06:49 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:49 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c" returned: 0 in 0.352s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:49 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info
Sep 25 17:06:49 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:50 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info" returned: 0 in 0.494s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 17:06:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:50 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info
Sep 25 17:06:50 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:50 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.info" returned: 0 in 0.450s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.246s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b7c79d71-e487-4726-b685-50587024a851 tempest-GroupSnapshotsV319Test-2105085334 None] group_snapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: created successfully
Sep 25 17:06:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] group_snapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: deleting
Sep 25 17:06:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] group_snapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 17:06:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "cinder-quobyte-0b786f96-1627-4baa-b2f9-2b559de1fc5c" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-0b786f96-1627-4baa-b2f9-2b559de1fc5c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Deleting offline snapshot 0b786f96-1627-4baa-b2f9-2b559de1fc5c of volume 488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] snapshot_file for this snap is: volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54126ce-ced0-4066-8fca-5a07a1404021]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:53 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c
Sep 25 17:06:53 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:53 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:06:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9c500-27b9-45e6-b87d-0462400b9c6c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:54 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d
Sep 25 17:06:54 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:54 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d" returned: 0 in 0.724s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:54 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c
Sep 25 17:06:54 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:55 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c" returned: 0 in 0.602s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:55 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c
Sep 25 17:06:55 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:55 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d.0b786f96-1627-4baa-b2f9-2b559de1fc5c" returned: 0 in 0.486s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-0b786f96-1627-4baa-b2f9-2b559de1fc5c" released by "_delete_snapshot" :: held 2.850s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" released by "delete_snapshot" :: held 2.889s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:56 devstack cinder-volume[86955]: WARNING cinder.quota [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-720296748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-720296748, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:56 devstack cinder-volume[86955]: WARNING cinder.quota [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-720296748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-720296748, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:56 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] Created reservations ['bc788284-f91d-4905-b107-e677e6bd7a9a', '03b6da80-7f35-4104-bed1-4f9601f42a74', '4d3fcc3c-5204-4694-be30-38af6da154f6', '25141d50-c3bc-48f5-8261-0bca7c0d0ea5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d79ca197-7992-4d51-a0ed-7adc1d37567f tempest-GroupSnapshotsV319Test-2105085334 None] group_snapshot 8457c96d-f757-492a-9f30-5a03bbfd44cf: deleted successfully
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8960505c-af89-45c8-8ef1-486972885cab]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:57 devstack sudo[95773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d
Sep 25 17:06:57 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:57 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:57 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d
Sep 25 17:06:57 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:58 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-488a690c-2bd5-46b1-8cb2-59ef3c58689d" returned: 0 in 0.380s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Lock "cinder-quobyte-488a690c-2bd5-46b1-8cb2-59ef3c58689d" released by "delete_volume" :: held 1.219s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Flow 'volume_create_manager' (6de34ae5-9689-4047-ae47-33ec7fcf19c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5ebcd-6618-4ef8-89df-9bf4aef39185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Created reservations ['2691df2a-8eef-4949-8f6d-829a187151d9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc5ebcd-6618-4ef8-89df-9bf4aef39185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1023398747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3401ab3-3503-4edd-a1a2-302e5d48b3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b9210cf8249f2aa5274e7f222e68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:58Z,use_quota=True,user_id='6b035ce73a614870af0591b974074483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a74a99f-5cf8-4466-ad8c-249a6508b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a74a99f-5cf8-4466-ad8c-249a6508b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8a8386-5564-4ee2-b244-794f94bcdbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8a8386-5564-4ee2-b244-794f94bcdbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3401ab3-3503-4edd-a1a2-302e5d48b3c2', 'volume_name': 'volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93c4f8-9ad8-44b5-a73a-dea430a073f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc93c4f8-9ad8-44b5-a73a-dea430a073f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd4eafa-aaa4-459c-91ab-773384a95325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2', 'volume_size': 1}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1023398747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3401ab3-3503-4edd-a1a2-302e5d48b3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b9210cf8249f2aa5274e7f222e68b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:58Z,use_quota=True,user_id='6b035ce73a614870af0591b974074483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Creating volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:06:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:58 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 1073741824
Sep 25 17:06:58 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:58 devstack cinder-volume[86955]: WARNING cinder.quota [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-720296748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-720296748, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Created reservations ['ba1daaea-16f6-4554-a36d-d55e59b95b0a', '4741212f-dea8-4ffe-91a0-4e15e694a38a', '821454f8-9115-4910-b004-eacceae45637', 'b148a965-1840-4104-96cf-67a3835e1e46'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:58 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:06:58 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:59 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.413s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:06:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-eba65bb5-ea70-47d4-b1b8-fa227dc242eb tempest-GroupSnapshotsV319Test-2105085334 None] Delete group completed successfully.
Sep 25 17:06:59 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 1073741824" returned: 0 in 0.751s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:06:59 devstack sudo[95815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2
Sep 25 17:06:59 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:06:59 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd4eafa-aaa4-459c-91ab-773384a95325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0d53c0-7ecc-4568-b8a4-39157cbced62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:06:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Volume volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 (b3401ab3-3503-4edd-a1a2-302e5d48b3c2): created successfully
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0d53c0-7ecc-4568-b8a4-39157cbced62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:06:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Flow 'volume_create_manager' (6de34ae5-9689-4047-ae47-33ec7fcf19c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:06:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ad5c32bc-78ef-477c-acdd-d73f6e3e8935 tempest-SnapshotsActionsTest-2105383563 None] Created volume successfully.
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Creating offline snapshot 4bcef554-2ff9-45a5-827e-8d7cb6e10799 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7dfb56-9315-4a1c-a4d4-e766d118c3c1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:01 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2
Sep 25 17:07:01 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:01 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:01 devstack sudo[95824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 1G
Sep 25 17:07:01 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:02 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Flow 'volume_create_manager' (9be11cb2-3b45-4bfb-a6f7-80d736022e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a38170-9ecb-4dbb-85d2-13dfa83f593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 1G" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a38170-9ecb-4dbb-85d2-13dfa83f593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525315671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707b436a-56f3-497f-ab6a-50006fd0c014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6edc99769c04eb5901eaef08aa207cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:02Z,use_quota=True,user_id='bdf07fec880f4774a63906c3e3b4d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f4fdcc-fa2b-4634-bfe4-251bc6d80e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:02 devstack sudo[95830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:02 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f4fdcc-fa2b-4634-bfe4-251bc6d80e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69659626-9d23-47e1-b729-bb51f3413e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69659626-9d23-47e1-b729-bb51f3413e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707b436a-56f3-497f-ab6a-50006fd0c014', 'volume_name': 'volume-707b436a-56f3-497f-ab6a-50006fd0c014', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1f022c-2efb-449b-bd18-213e07c7e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1f022c-2efb-449b-bd18-213e07c7e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d464b7d-e86a-4699-8675-a02222179e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Volume 707b436a-56f3-497f-ab6a-50006fd0c014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707b436a-56f3-497f-ab6a-50006fd0c014', 'volume_size': 1}
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:02 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.345s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:02 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 is being set with open permissions: ugo+rw
Sep 25 17:07:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:02 devstack sudo[95835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:02 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:03 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.306s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:03 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info
Sep 25 17:07:03 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:03 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info is being set with open permissions: ugo+rw
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:03 devstack sudo[95841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:03 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:03 devstack sudo[95842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info
Sep 25 17:07:03 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:03 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.info" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:03 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525315671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707b436a-56f3-497f-ab6a-50006fd0c014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6edc99769c04eb5901eaef08aa207cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:02Z,use_quota=True,user_id='bdf07fec880f4774a63906c3e3b4d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Creating volume 707b436a-56f3-497f-ab6a-50006fd0c014 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:03 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.409s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:07:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:07:03 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 1073741824
Sep 25 17:07:03 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aef50203-f451-49e5-a6aa-1be5e262b5be tempest-SnapshotsActionsTest-2105383563 None] Create snapshot completed successfully
Sep 25 17:07:04 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 1073741824" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:04 devstack sudo[95854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014
Sep 25 17:07:04 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:05 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014" returned: 0 in 0.316s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d464b7d-e86a-4699-8675-a02222179e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707b436a-56f3-497f-ab6a-50006fd0c014', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d26024-07e3-4e7b-9042-bd294d7b4e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Volume volume-707b436a-56f3-497f-ab6a-50006fd0c014 (707b436a-56f3-497f-ab6a-50006fd0c014): created successfully
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d26024-07e3-4e7b-9042-bd294d7b4e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Flow 'volume_create_manager' (9be11cb2-3b45-4bfb-a6f7-80d736022e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e0353edf-a6bf-45b0-9eaf-623a08dc711a tempest-ServersNegativeTestJSON-759067603 None] Created volume successfully.
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Creating offline snapshot e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f67f7-a7d7-4e59-9593-ab5d3375b84b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:05 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:05 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:05 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:06 devstack sudo[95862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd 1G
Sep 25 17:07:06 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:06 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd 1G" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:06 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd
Sep 25 17:07:06 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:07 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:07 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd is being set with open permissions: ugo+rw
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:07 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd
Sep 25 17:07:07 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:07 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" returned: 0 in 0.369s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6220c644-732a-41d0-a9b7-d627a84f75f9 tempest-SnapshotsActionsTest-2105383563 None] Create snapshot completed successfully
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Flow 'volume_create_manager' (7eb194d8-bd2e-4db3-ae55-d36c020e1313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a21193-8426-41c0-b8c8-58fc86a9f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a21193-8426-41c0-b8c8-58fc86a9f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-197901502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce0a012-da50-4890-a3a4-33223fea43ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6edc99769c04eb5901eaef08aa207cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:08Z,use_quota=True,user_id='bdf07fec880f4774a63906c3e3b4d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e13d5de-08d1-4f31-9d69-880ae5d6792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e13d5de-08d1-4f31-9d69-880ae5d6792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43398c8-cd7b-4af2-b973-2fdd8a3abf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43398c8-cd7b-4af2-b973-2fdd8a3abf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce0a012-da50-4890-a3a4-33223fea43ba', 'volume_name': 'volume-9ce0a012-da50-4890-a3a4-33223fea43ba', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2b5ce-fc98-45c4-99ac-ceefd3c2b27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2b5ce-fc98-45c4-99ac-ceefd3c2b27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2af67-8592-483d-9575-c1132d956ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Volume 9ce0a012-da50-4890-a3a4-33223fea43ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce0a012-da50-4890-a3a4-33223fea43ba', 'volume_size': 1}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-197901502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce0a012-da50-4890-a3a4-33223fea43ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6edc99769c04eb5901eaef08aa207cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:08Z,use_quota=True,user_id='bdf07fec880f4774a63906c3e3b4d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Creating volume 9ce0a012-da50-4890-a3a4-33223fea43ba {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:07 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba 1073741824
Sep 25 17:07:07 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:08 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba 1073741824" returned: 0 in 0.531s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:08 devstack sudo[95885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba
Sep 25 17:07:08 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:08 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba" returned: 0 in 0.338s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aff81286-ffe7-4dc4-a4a1-bbc76d3365a8 tempest-GroupsTest-1438756684 None] Group tempest-Group1-1961559707: creating
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d2af67-8592-483d-9575-c1132d956ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce0a012-da50-4890-a3a4-33223fea43ba', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55642604-1862-48d3-9fb2-c1a90b3780d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Volume volume-9ce0a012-da50-4890-a3a4-33223fea43ba (9ce0a012-da50-4890-a3a4-33223fea43ba): created successfully
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55642604-1862-48d3-9fb2-c1a90b3780d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Flow 'volume_create_manager' (7eb194d8-bd2e-4db3-ae55-d36c020e1313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d64aaf58-8954-4803-b7a1-7cc99f984abd tempest-ServersNegativeTestJSON-759067603 None] Created volume successfully.
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aff81286-ffe7-4dc4-a4a1-bbc76d3365a8 tempest-GroupsTest-1438756684 None] Group tempest-Group1-1961559707: created successfully
Sep 25 17:07:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aff81286-ffe7-4dc4-a4a1-bbc76d3365a8 tempest-GroupsTest-1438756684 None] Create group completed successfully.
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Deleting offline snapshot e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] snapshot_file for this snap is: volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1643f1c1-1caa-4941-a534-5b312847ddec]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:09 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd
Sep 25 17:07:09 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:09 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" returned: 0 in 0.490s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[96919bfe-cfdf-46c3-8b8a-ec6398302ff5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:09 devstack sudo[95893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:09 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:09 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.428s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:09 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd
Sep 25 17:07:09 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e668e05d-ab38-4904-8f20-ac9c06f228fa tempest-GroupsTest-1438756684 None] Group tempest-Group2-391936712: creating
Sep 25 17:07:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e668e05d-ab38-4904-8f20-ac9c06f228fa tempest-GroupsTest-1438756684 None] Group tempest-Group2-391936712: created successfully
Sep 25 17:07:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e668e05d-ab38-4904-8f20-ac9c06f228fa tempest-GroupsTest-1438756684 None] Create group completed successfully.
Sep 25 17:07:10 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" returned: 0 in 0.482s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "cinder-9ce0a012-da50-4890-a3a4-33223fea43ba-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:10 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd
Sep 25 17:07:10 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-9ce0a012-da50-4890-a3a4-33223fea43ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "cinder-quobyte-9ce0a012-da50-4890-a3a4-33223fea43ba" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-quobyte-9ce0a012-da50-4890-a3a4-33223fea43ba" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a63add-012f-416e-9c01-388f66d4bf31]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:10 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba
Sep 25 17:07:10 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:10 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd" released by "_delete_snapshot" :: held 1.881s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_snapshot" :: held 1.920s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Created reservations ['e97aa927-41bb-418f-9b15-6cd936523be9', 'e6fc5c5e-9f88-4e28-acc5-1a6b8acc0eff', 'ce824323-ddf7-4b52-989f-12c3e29f1140', 'a2dd7f18-e9e6-42cf-ad5d-627b6ba3bd71'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Delete snapshot completed successfully.
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-424ed306-0b8b-4cc8-90e7-d8d7ca735fb6 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-e9adacfe-4fec-4f2a-a11f-dc8eb3fde4fd-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:10 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba" returned: 0 in 0.433s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:11 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba
Sep 25 17:07:11 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:11 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ce0a012-da50-4890-a3a4-33223fea43ba" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-quobyte-9ce0a012-da50-4890-a3a4-33223fea43ba" released by "delete_volume" :: held 0.844s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Creating offline snapshot 08355266-cd9f-4b63-98c3-12fc8f25f11f of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[beab78ff-6404-4728-bbeb-d7037a206b7a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Created reservations ['86dbc620-83e2-401b-bad7-e79a586f56b0', '4583e966-68f8-4565-ad3f-9756a3f2e84b', '55674a4b-6b81-478d-92b9-303fc625907a', 'e6d55ba5-d14c-4371-bd20-9d965d8d080f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:11 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:11 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:11 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:11 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:11 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.290s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Deleted volume successfully.
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9d1ec603-e082-426c-80cd-16c393d86799 tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-9ce0a012-da50-4890-a3a4-33223fea43ba-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (3d6bfe1a-a5b8-400c-91b1-79ec4e9218c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c528dce-bbf3-4575-8f77-f0bfd9fe033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c528dce-bbf3-4575-8f77-f0bfd9fe033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704564729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=250e8809-710c-42da-9508-ee21ec7985b7,host='devstack@QuobyteHD#QuobyteHD',id=31c6241d-ada0-4727-873d-67b05d9a86d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:12Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b5e4332-47c4-431a-9098-c71923c72532),volume_type_id=6b5e4332-47c4-431a-9098-c71923c72532)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb232eef-65e3-4ae1-adbc-9b65fbd32fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:12 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb232eef-65e3-4ae1-adbc-9b65fbd32fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8715505b-e79a-4514-9291-7c52ffa4f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8715505b-e79a-4514-9291-7c52ffa4f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c6241d-ada0-4727-873d-67b05d9a86d7', 'volume_name': 'volume-31c6241d-ada0-4727-873d-67b05d9a86d7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1117bd77-726c-4f8c-a0a4-9f110fd23564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1117bd77-726c-4f8c-a0a4-9f110fd23564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f5d30-20f8-45cd-aac5-13a711f645b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Volume 31c6241d-ada0-4727-873d-67b05d9a86d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c6241d-ada0-4727-873d-67b05d9a86d7', 'volume_size': 1}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:12 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f 1G
Sep 25 17:07:12 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "cinder-707b436a-56f3-497f-ab6a-50006fd0c014-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-707b436a-56f3-497f-ab6a-50006fd0c014-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "cinder-quobyte-707b436a-56f3-497f-ab6a-50006fd0c014" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-quobyte-707b436a-56f3-497f-ab6a-50006fd0c014" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b98b07-1da7-4c50-86b8-4c76671a0a64]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:12 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f 1G" returned: 0 in 0.588s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:12 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f
Sep 25 17:07:12 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:12 devstack sudo[95930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014
Sep 25 17:07:12 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:13 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f" returned: 0 in 0.370s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:13 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f is being set with open permissions: ugo+rw
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:13 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f
Sep 25 17:07:13 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:13 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014" returned: 0 in 0.485s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:13 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014
Sep 25 17:07:13 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:13 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f" returned: 0 in 0.326s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=250e8809-710c-42da-9508-ee21ec7985b7,created_at=2026-09-25T15:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704564729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=250e8809-710c-42da-9508-ee21ec7985b7,host='devstack@QuobyteHD#QuobyteHD',id=31c6241d-ada0-4727-873d-67b05d9a86d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:12Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b5e4332-47c4-431a-9098-c71923c72532),volume_type_id=6b5e4332-47c4-431a-9098-c71923c72532)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Creating volume 31c6241d-ada0-4727-873d-67b05d9a86d7 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:13 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-707b436a-56f3-497f-ab6a-50006fd0c014" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:13 devstack sudo[95948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 1073741824
Sep 25 17:07:13 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-quobyte-707b436a-56f3-497f-ab6a-50006fd0c014" released by "delete_volume" :: held 0.951s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e7e5e928-c981-4426-9778-34daa2df4069 tempest-SnapshotsActionsTest-2105383563 None] Create snapshot completed successfully
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Created reservations ['1f819417-ac86-4576-bbe1-c69a0c79b9c7', '78e663b3-2c51-4056-83de-05890e37f37b', '0b28a9d5-276d-4e7d-bc31-4c58d67f575c', '173aadea-ea04-441a-9ac8-bb0a7d2e4d1d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:13 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:13 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:14 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.314s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Deleted volume successfully.
Sep 25 17:07:14 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 1073741824" returned: 0 in 0.597s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ee2049b-7460-4de5-8382-13b468a92b6a tempest-ServersNegativeTestJSON-759067603 None] Lock "cinder-707b436a-56f3-497f-ab6a-50006fd0c014-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:14 devstack sudo[95968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7
Sep 25 17:07:14 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:14 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7" returned: 0 in 0.395s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036f5d30-20f8-45cd-aac5-13a711f645b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c6241d-ada0-4727-873d-67b05d9a86d7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c136d0c7-75c3-48ed-a261-4e9171a706e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Volume volume-31c6241d-ada0-4727-873d-67b05d9a86d7 (31c6241d-ada0-4727-873d-67b05d9a86d7): created successfully
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c136d0c7-75c3-48ed-a261-4e9171a706e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (3d6bfe1a-a5b8-400c-91b1-79ec4e9218c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b2122177-bc57-4495-b070-70e4105ddb7a tempest-GroupsTest-1438756684 None] Created volume successfully.
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-08355266-cd9f-4b63-98c3-12fc8f25f11f-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-08355266-cd9f-4b63-98c3-12fc8f25f11f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-08355266-cd9f-4b63-98c3-12fc8f25f11f" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-08355266-cd9f-4b63-98c3-12fc8f25f11f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Deleting offline snapshot 08355266-cd9f-4b63-98c3-12fc8f25f11f of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] snapshot_file for this snap is: volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e02cac4-1f52-4586-a184-bb4d10f6939a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:15 devstack sudo[95971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f
Sep 25 17:07:15 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:15 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f" returned: 0 in 0.551s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe008b4f-fadd-41a7-8c6a-2b3416db511d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:15 devstack sudo[95979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:15 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:16 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.752s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:16 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f
Sep 25 17:07:16 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:16 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f" returned: 0 in 0.550s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:16 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f
Sep 25 17:07:16 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Acquiring lock "cinder-quobyte-31c6241d-ada0-4727-873d-67b05d9a86d7" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-31c6241d-ada0-4727-873d-67b05d9a86d7" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e6daf-fafe-42e6-a3a7-8d70e75e11fa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:17 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7
Sep 25 17:07:17 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:17 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.08355266-cd9f-4b63-98c3-12fc8f25f11f" returned: 0 in 0.464s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-08355266-cd9f-4b63-98c3-12fc8f25f11f" released by "_delete_snapshot" :: held 2.520s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_snapshot" :: held 2.552s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Created reservations ['3e1a60bf-8b09-4a47-92e2-9fb6456b4608', 'a94c8718-f727-4479-b7b4-f20212af2f50', '608ea17e-de51-4ab3-9b20-348d5b7b0151', 'b0147e63-1a02-41e2-8fb8-ff22537842aa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Delete snapshot completed successfully.
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2c3abc7e-931b-47bd-b748-c397f021561a tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-08355266-cd9f-4b63-98c3-12fc8f25f11f-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:17 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:17 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7
Sep 25 17:07:17 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:17 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31c6241d-ada0-4727-873d-67b05d9a86d7" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-31c6241d-ada0-4727-873d-67b05d9a86d7" released by "delete_volume" :: held 1.046s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Created reservations ['63f31be9-c060-44cd-b9aa-b3fff8fa6e95'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:18 devstack cinder-volume[86955]: WARNING cinder.quota [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1842928217 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1842928217, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:07:18 devstack cinder-volume[86955]: WARNING cinder.quota [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1842928217 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1842928217, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Created reservations ['3e16b69a-91e3-4467-b8c2-0013ede7ca28', 'dd2d5da2-62aa-4523-a5f0-cc5274e62710', '10650af8-0006-484b-a6c6-9eb09ab8037b', 'b58420ad-f457-45dc-880f-13c93fbe3148'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:18 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:18 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Creating offline snapshot a31773ca-bfdf-4d69-a7a0-e10758e94216 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d14ac-4098-4229-a25a-880f228528e2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:18 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.350s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:18 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:18 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dc2df256-e9f1-45d2-ac10-c5f291613f6f tempest-GroupsTest-1438756684 None] Delete group completed successfully.
Sep 25 17:07:18 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:18 devstack sudo[96034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 1G
Sep 25 17:07:18 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Created reservations ['91d0b4d0-85de-4f0b-9689-e9286709fe3f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:19 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 1G" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:19 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216
Sep 25 17:07:19 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:19 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:19 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:19 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.328s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:19 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:20 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 is being set with open permissions: ugo+rw
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1286d60c-88af-46ff-ab5d-7c48faba6675 tempest-GroupsTest-1438756684 None] Delete group completed successfully.
Sep 25 17:07:20 devstack sudo[96050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216
Sep 25 17:07:20 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:20 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216" returned: 0 in 0.297s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=118,cinder:UPDATE=118,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1ea94d65-2a9b-4e54-a3ab-c121a216d0b3 tempest-SnapshotsActionsTest-2105383563 None] Create snapshot completed successfully
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-a31773ca-bfdf-4d69-a7a0-e10758e94216-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-a31773ca-bfdf-4d69-a7a0-e10758e94216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-a31773ca-bfdf-4d69-a7a0-e10758e94216" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-a31773ca-bfdf-4d69-a7a0-e10758e94216" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Deleting offline snapshot a31773ca-bfdf-4d69-a7a0-e10758e94216 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] snapshot_file for this snap is: volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac0778-b829-47f4-8f6e-2e63a2a94e5f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:21 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216
Sep 25 17:07:21 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e028dac-5913-409f-a146-7521d5ed084d tempest-GroupsTest-1438756684 None] Group tempest-GroupsTest-Group-1176166434: creating
Sep 25 17:07:21 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216" returned: 0 in 0.553s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e028dac-5913-409f-a146-7521d5ed084d tempest-GroupsTest-1438756684 None] Group tempest-GroupsTest-Group-1176166434: created successfully
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698bd91-9cfd-4a1c-b5ed-c816b382df3c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e028dac-5913-409f-a146-7521d5ed084d tempest-GroupsTest-1438756684 None] Create group completed successfully.
Sep 25 17:07:21 devstack sudo[96063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:21 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:21 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.425s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:21 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216
Sep 25 17:07:21 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:22 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:22 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216
Sep 25 17:07:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:22 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.a31773ca-bfdf-4d69-a7a0-e10758e94216" returned: 0 in 0.437s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-a31773ca-bfdf-4d69-a7a0-e10758e94216" released by "_delete_snapshot" :: held 1.996s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_snapshot" :: held 2.040s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Created reservations ['f2c5114d-d734-441c-944a-4b866d6e7091', 'd788c32f-0a69-406c-9054-6d6d3147d04d', '359e3a1b-e0d7-4334-a3ec-93f618fed476', 'e640fe1a-4050-4f73-b1d6-9c395bb51fbb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Delete snapshot completed successfully.
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a0e3c92d-91d2-41e9-b8f6-9281f0d903e3 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-a31773ca-bfdf-4d69-a7a0-e10758e94216-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (1eb317d0-3995-4640-b93c-69e56c827092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8390f83d-1e2a-4559-bdfe-713059ffc8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8390f83d-1e2a-4559-bdfe-713059ffc8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953292924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,host='devstack@QuobyteHD#QuobyteHD',id=772229ae-2fcd-4932-9e6c-dc25c393084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:23Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18793fca-a38f-4c33-97e7-8c4852d138a6),volume_type_id=18793fca-a38f-4c33-97e7-8c4852d138a6)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9df121-634c-418b-b0a2-12c2d4d8858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9df121-634c-418b-b0a2-12c2d4d8858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eba2d12-5e0a-4e3a-8fd5-d54cd4c7d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eba2d12-5e0a-4e3a-8fd5-d54cd4c7d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772229ae-2fcd-4932-9e6c-dc25c393084b', 'volume_name': 'volume-772229ae-2fcd-4932-9e6c-dc25c393084b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fef725-1f43-404e-b199-4b4bdc732918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fef725-1f43-404e-b199-4b4bdc732918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9860e2c-960e-4943-8305-0fb53630fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Volume 772229ae-2fcd-4932-9e6c-dc25c393084b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772229ae-2fcd-4932-9e6c-dc25c393084b', 'volume_size': 1}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,created_at=2026-09-25T15:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953292924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,host='devstack@QuobyteHD#QuobyteHD',id=772229ae-2fcd-4932-9e6c-dc25c393084b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:23Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18793fca-a38f-4c33-97e7-8c4852d138a6),volume_type_id=18793fca-a38f-4c33-97e7-8c4852d138a6)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Creating volume 772229ae-2fcd-4932-9e6c-dc25c393084b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:23 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b 1073741824
Sep 25 17:07:23 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:24 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b 1073741824" returned: 0 in 0.819s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:24 devstack sudo[96116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b
Sep 25 17:07:24 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:24 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.457s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Creating offline snapshot 285be92c-e31c-4b75-b649-6a5928a802a2 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9860e2c-960e-4943-8305-0fb53630fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772229ae-2fcd-4932-9e6c-dc25c393084b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e523e29-8876-49b1-b875-329f1c2237e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1619ff-fdbc-4577-bd52-9a528a97fda7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Volume volume-772229ae-2fcd-4932-9e6c-dc25c393084b (772229ae-2fcd-4932-9e6c-dc25c393084b): created successfully
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e523e29-8876-49b1-b875-329f1c2237e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (1eb317d0-3995-4640-b93c-69e56c827092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4942f481-695b-4d5a-8150-42d91e4006c5 tempest-GroupsTest-1438756684 None] Created volume successfully.
Sep 25 17:07:25 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:25 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:25 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:25 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 1G
Sep 25 17:07:25 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:26 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 1G" returned: 0 in 0.608s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:26 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2
Sep 25 17:07:26 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:26 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 is being set with open permissions: ugo+rw
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:27 devstack sudo[96218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2
Sep 25 17:07:27 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:27 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2" returned: 0 in 0.555s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aedf6b41-cffa-41ba-a2ea-44341c6ec4b6 tempest-SnapshotsActionsTest-2105383563 None] Create snapshot completed successfully
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (403e38d4-708a-4202-8fd6-83802ecda54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0760c048-21b4-44cc-a183-4ac83101dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0760c048-21b4-44cc-a183-4ac83101dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358550052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,host='devstack@QuobyteHD#QuobyteHD',id=9e596077-4566-470c-b5c7-b6023f6c571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:28Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18793fca-a38f-4c33-97e7-8c4852d138a6),volume_type_id=18793fca-a38f-4c33-97e7-8c4852d138a6)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e758e-0622-4069-87dd-96c9aa92ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e758e-0622-4069-87dd-96c9aa92ac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b02f8a-6904-4117-ae68-67629b09db68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b02f8a-6904-4117-ae68-67629b09db68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e596077-4566-470c-b5c7-b6023f6c571d', 'volume_name': 'volume-9e596077-4566-470c-b5c7-b6023f6c571d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc52adaf-92c1-4ab0-aa15-2d9534765a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc52adaf-92c1-4ab0-aa15-2d9534765a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa779c4-1839-43a0-add3-4ca71c2e109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Volume 9e596077-4566-470c-b5c7-b6023f6c571d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e596077-4566-470c-b5c7-b6023f6c571d', 'volume_size': 1}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,created_at=2026-09-25T15:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358550052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d4c32d8-3616-4289-a7c0-8ea6cf6be50e,host='devstack@QuobyteHD#QuobyteHD',id=9e596077-4566-470c-b5c7-b6023f6c571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a18f542f74405199b3410c4697245e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:28Z,use_quota=True,user_id='f2a74a54c37e40e4b67b152455dbca4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18793fca-a38f-4c33-97e7-8c4852d138a6),volume_type_id=18793fca-a38f-4c33-97e7-8c4852d138a6)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Creating volume 9e596077-4566-470c-b5c7-b6023f6c571d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:28 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:28 devstack sudo[96251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d 1073741824
Sep 25 17:07:28 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:28 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d 1073741824" returned: 0 in 0.603s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:28 devstack sudo[96274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d
Sep 25 17:07:28 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-285be92c-e31c-4b75-b649-6a5928a802a2-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-285be92c-e31c-4b75-b649-6a5928a802a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Acquiring lock "cinder-quobyte-285be92c-e31c-4b75-b649-6a5928a802a2" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-285be92c-e31c-4b75-b649-6a5928a802a2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Deleting offline snapshot 285be92c-e31c-4b75-b649-6a5928a802a2 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:07:29 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] snapshot_file for this snap is: volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa779c4-1839-43a0-add3-4ca71c2e109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e596077-4566-470c-b5c7-b6023f6c571d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69c8fc5-8c5b-40ec-a885-988c4e56b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc28bb5-1036-4589-a85c-2a235125ca0d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Volume volume-9e596077-4566-470c-b5c7-b6023f6c571d (9e596077-4566-470c-b5c7-b6023f6c571d): created successfully
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69c8fc5-8c5b-40ec-a885-988c4e56b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Flow 'volume_create_manager' (403e38d4-708a-4202-8fd6-83802ecda54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7f33c842-0ae4-4228-b326-c8827555af80 tempest-GroupsTest-1438756684 None] Created volume successfully.
Sep 25 17:07:29 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2
Sep 25 17:07:29 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:29 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2" returned: 0 in 0.519s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5857609b-35cf-455a-8d0f-9ab39b50376b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:29 devstack sudo[96292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:29 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:30 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.781s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:30 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2
Sep 25 17:07:30 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-335b1bfc-383d-4564-98e3-5e3b008307b3 tempest-GroupsTest-1438756684 None] Update group completed successfully.
Sep 25 17:07:31 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:31 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2
Sep 25 17:07:31 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:31 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.285be92c-e31c-4b75-b649-6a5928a802a2" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-285be92c-e31c-4b75-b649-6a5928a802a2" released by "_delete_snapshot" :: held 2.667s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_snapshot" :: held 2.710s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Created reservations ['5a30c831-e8e9-4c89-9eb1-488b8c8326b7', '5ef5a376-23e7-4e7e-8d87-0fcbf3e8c5ab', 'ab50996d-7641-47ca-b7dc-79b04e64b551', '90714275-f674-4e7b-8398-aab411ed21ab'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Delete snapshot completed successfully.
Sep 25 17:07:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c189d65-3214-47d7-ab58-3ad7ee961a07 tempest-SnapshotsActionsTest-720826568 None] Lock "cinder-285be92c-e31c-4b75-b649-6a5928a802a2-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bcef1965-dfde-425d-9ae3-773decdfc13e tempest-GroupsTest-1438756684 None] Update group completed successfully.
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "cinder-4bcef554-2ff9-45a5-827e-8d7cb6e10799-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-4bcef554-2ff9-45a5-827e-8d7cb6e10799-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "cinder-quobyte-4bcef554-2ff9-45a5-827e-8d7cb6e10799" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Flow 'volume_create_manager' (e2b55a71-1d3a-4380-bf2b-d0896604fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47882190-d36e-423f-b926-7130896e8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47882190-d36e-423f-b926-7130896e8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-900686724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf1de19-2d73-474d-8961-aeff882593c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a9f4453b64db5b6bd996cb3ee2c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:33Z,use_quota=True,user_id='88e35f96fe974342838fe3de159b7d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7013b93b-2448-40fc-bb0d-1c31ae059bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7013b93b-2448-40fc-bb0d-1c31ae059bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583cde03-1ec2-484e-a254-34b2404f9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583cde03-1ec2-484e-a254-34b2404f9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf1de19-2d73-474d-8961-aeff882593c8', 'volume_name': 'volume-acf1de19-2d73-474d-8961-aeff882593c8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffa0369-2e25-4341-b4a6-04e8bfc4911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffa0369-2e25-4341-b4a6-04e8bfc4911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598999f2-80a3-49d9-a23f-50014f9e502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Volume acf1de19-2d73-474d-8961-aeff882593c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf1de19-2d73-474d-8961-aeff882593c8', 'volume_size': 1}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-900686724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf1de19-2d73-474d-8961-aeff882593c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9a9f4453b64db5b6bd996cb3ee2c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:33Z,use_quota=True,user_id='88e35f96fe974342838fe3de159b7d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Creating volume acf1de19-2d73-474d-8961-aeff882593c8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:07:32 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-4bcef554-2ff9-45a5-827e-8d7cb6e10799" acquired by "_delete_snapshot" :: waited 0.132s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Deleting offline snapshot 4bcef554-2ff9-45a5-827e-8d7cb6e10799 of volume b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:07:32 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 1073741824
Sep 25 17:07:32 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] snapshot_file for this snap is: volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620aa30-0ed4-477e-80f2-97cb7c61b25c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:33 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:33 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:33 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.622s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:07:33 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 1073741824" returned: 0 in 0.726s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e21ec7-6abb-4430-8334-e875b854fa01]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:33 devstack sudo[96327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2
Sep 25 17:07:33 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:33 devstack sudo[96328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8
Sep 25 17:07:33 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:34 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" returned: 0 in 0.482s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:34 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:34 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:34 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598999f2-80a3-49d9-a23f-50014f9e502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf1de19-2d73-474d-8961-aeff882593c8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c451cf1-d853-4cda-b04f-e8eb1835e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Acquiring lock "cinder-quobyte-772229ae-2fcd-4932-9e6c-dc25c393084b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Volume volume-acf1de19-2d73-474d-8961-aeff882593c8 (acf1de19-2d73-474d-8961-aeff882593c8): created successfully
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c451cf1-d853-4cda-b04f-e8eb1835e123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Flow 'volume_create_manager' (e2b55a71-1d3a-4380-bf2b-d0896604fd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-772229ae-2fcd-4932-9e6c-dc25c393084b" acquired by "delete_volume" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-63a5df01-27e7-4c41-be3c-882771e80098 tempest-TestMinimumBasicScenario-1972809467 None] Created volume successfully.
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05432a0-b9ca-46da-936d-a349fda0a7e1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:34 devstack sudo[96338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b
Sep 25 17:07:34 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:34 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.572s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:34 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799
Sep 25 17:07:34 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:35 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b" returned: 0 in 0.651s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:35 devstack sudo[96349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b
Sep 25 17:07:35 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:35 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2.4bcef554-2ff9-45a5-827e-8d7cb6e10799" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-4bcef554-2ff9-45a5-827e-8d7cb6e10799" released by "_delete_snapshot" :: held 2.317s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_snapshot" :: held 2.458s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Created reservations ['b49ae62a-91e0-43d2-984d-3e5f8b977718', '31d3e1d9-1d6d-4400-9d19-c4f90ba17ed4', '0955f584-9361-4081-8756-969aa7b61547', 'f6196766-cbaa-4248-9179-8c1a706ddea3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:35 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-772229ae-2fcd-4932-9e6c-dc25c393084b" returned: 0 in 0.422s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-772229ae-2fcd-4932-9e6c-dc25c393084b" released by "delete_volume" :: held 1.154s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Acquiring lock "cinder-quobyte-9e596077-4566-470c-b5c7-b6023f6c571d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Delete snapshot completed successfully.
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-9e596077-4566-470c-b5c7-b6023f6c571d" acquired by "delete_volume" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7bb5f14-acb6-4552-82c1-7510a4b6a9c0 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-4bcef554-2ff9-45a5-827e-8d7cb6e10799-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[84621a54-868e-4eaf-b11e-6e0eb83065aa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:35 devstack sudo[96356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d
Sep 25 17:07:35 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:36 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "cinder-b3401ab3-3503-4edd-a1a2-302e5d48b3c2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d" returned: 0 in 0.593s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-b3401ab3-3503-4edd-a1a2-302e5d48b3c2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:36 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d
Sep 25 17:07:36 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee96593-483f-4d8d-9518-1822356cd440]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c0d324f3-29d9-4a4e-af01-34c9f9ebee74 req-cf0cd1c2-4ddc-48f7-a226-bf7671c4fe0d tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c0d324f3-29d9-4a4e-af01-34c9f9ebee74 req-cf0cd1c2-4ddc-48f7-a226-bf7671c4fe0d tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c0d324f3-29d9-4a4e-af01-34c9f9ebee74 req-cf0cd1c2-4ddc-48f7-a226-bf7671c4fe0d tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:36 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2
Sep 25 17:07:36 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-c0d324f3-29d9-4a4e-af01-34c9f9ebee74 req-cf0cd1c2-4ddc-48f7-a226-bf7671c4fe0d tempest-TestMinimumBasicScenario-1972809467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-acf1de19-2d73-474d-8961-aeff882593c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67142ff8-b40a-4e2f-b715-2f2ccbbcbf46', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:07:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-c0d324f3-29d9-4a4e-af01-34c9f9ebee74 req-cf0cd1c2-4ddc-48f7-a226-bf7671c4fe0d tempest-TestMinimumBasicScenario-1972809467 None] attachment_update completed successfully.
Sep 25 17:07:37 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9e596077-4566-470c-b5c7-b6023f6c571d" returned: 0 in 0.944s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "cinder-quobyte-9e596077-4566-470c-b5c7-b6023f6c571d" released by "delete_volume" :: held 1.625s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:37 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" returned: 0 in 0.689s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:37 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2
Sep 25 17:07:37 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Created reservations ['4a28272f-b3f4-4247-a4c1-a79bdeb7d27b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:37 devstack cinder-volume[86955]: WARNING cinder.quota [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1567417240 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1567417240, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:07:37 devstack cinder-volume[86955]: WARNING cinder.quota [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1567417240 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1567417240, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:07:37 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" returned: 0 in 0.435s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-quobyte-b3401ab3-3503-4edd-a1a2-302e5d48b3c2" released by "delete_volume" :: held 1.348s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Created reservations ['52ed9335-ce02-4323-b0fa-4d1bfbc55345', '73e8d33b-ae72-4d52-a66d-e10f721fa6a2', '82f250ec-d05c-41f1-be62-d0b4e9a1a901', 'fefb3d13-33b2-4d87-8c8d-3c1d7d4d75ca'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Created reservations ['38e21943-918a-43e6-93ba-a44259b0d507', 'd1966ae5-4a1d-4243-8b8c-28f5651bad52', 'e109efc3-796e-42de-b10e-698c1b435c68', 'affe3de9-193f-4eba-9a7e-346d362470d8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Created reservations ['d77f8e6a-215a-4a30-9336-9600b4908a82', '54e24303-4642-42eb-a8c1-3779e66a1198', '5cf3ced7-7b7c-4fc2-8b62-e4e04eca3990', 'bfe24934-5b6a-453d-b4b9-9905df70ff59'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:07:38 devstack sudo[96797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:38 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:07:38 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:07:38 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:07:38 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.599s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Deleted volume successfully.
Sep 25 17:07:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85091174-ace7-45b8-9c40-b2307e571cc6 tempest-SnapshotsActionsTest-2105383563 None] Lock "cinder-b3401ab3-3503-4edd-a1a2-302e5d48b3c2-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:07:39 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Sep 25 17:07:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.590s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:07:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:07:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c2884b16-aa64-4416-b100-45bc0d00a277 tempest-GroupsTest-1438756684 None] Delete group completed successfully.
Sep 25 17:07:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=49,cinder:UPDATE=54,cinder:INSERT=17,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:07:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=137,cinder:UPDATE=151,cinder:DELETE=10,cinder:INSERT=34 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:03 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:03 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:04 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.622s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:08:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:08:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Flow 'volume_create_manager' (58bd86ba-d44f-4847-9e44-449110e1e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b862b7f-006b-4bc7-ba94-878babae9189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b862b7f-006b-4bc7-ba94-878babae9189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-646749327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a2ccc-47e7-4ca7-a61d-bd62e975d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc234b1a6e249b9852d696eeb556da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:08Z,use_quota=True,user_id='d029a562a4364f1c9d3ecc0051c018a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05524983-06d7-4f67-aec9-f1b1e7a1ae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05524983-06d7-4f67-aec9-f1b1e7a1ae37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2feb95b-7df2-4967-8729-0c60ee48902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2feb95b-7df2-4967-8729-0c60ee48902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1a2ccc-47e7-4ca7-a61d-bd62e975d866', 'volume_name': 'volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c36a7-1b81-4845-81fc-f99220ace39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31c36a7-1b81-4845-81fc-f99220ace39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378dd499-7e24-49ee-b10c-7772bb3ef60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Volume fd1a2ccc-47e7-4ca7-a61d-bd62e975d866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866', 'volume_size': 1}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-646749327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a2ccc-47e7-4ca7-a61d-bd62e975d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc234b1a6e249b9852d696eeb556da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:08Z,use_quota=True,user_id='d029a562a4364f1c9d3ecc0051c018a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Creating volume fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:08 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 1073741824
Sep 25 17:08:08 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:08 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 1073741824" returned: 0 in 0.594s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:09 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866
Sep 25 17:08:09 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:09 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378dd499-7e24-49ee-b10c-7772bb3ef60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834263fd-64a2-4bd6-916c-0f17f2d3114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Volume volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 (fd1a2ccc-47e7-4ca7-a61d-bd62e975d866): created successfully
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834263fd-64a2-4bd6-916c-0f17f2d3114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Flow 'volume_create_manager' (58bd86ba-d44f-4847-9e44-449110e1e63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a3dcf17c-99dd-4589-9b57-1433cfe24d42 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Created volume successfully.
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Acquiring lock "cinder-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "cinder-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Acquiring lock "cinder-quobyte-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "cinder-quobyte-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" acquired by "delete_volume" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fdd239-0f8e-4c90-94b1-0bb2e9ba6be6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:12 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866
Sep 25 17:08:12 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:12 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" returned: 0 in 0.424s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:12 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866
Sep 25 17:08:12 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:12 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" returned: 0 in 0.271s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "cinder-quobyte-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866" released by "delete_volume" :: held 0.763s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Created reservations ['ff9b0d26-4fed-4376-8cc6-26f4f9ee682a', '6ac2546c-703e-4875-b795-7fb07dcaf1b4', 'f21d9d60-db55-4160-afee-65b94b3c4210', 'ff28a40e-d6de-430d-bc4b-5f7960dc03d0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:12 devstack sudo[97056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:12 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:13 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.367s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Deleted volume successfully.
Sep 25 17:08:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4e88097-656b-49fc-ae09-61b75fe2bd34 tempest-VolumeQuotasNegativeTestJSON-721696702 None] Lock "cinder-fd1a2ccc-47e7-4ca7-a61d-bd62e975d866-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Flow 'volume_create_manager' (4031e01b-a431-42d3-89c7-72d08af8f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67108817-a700-46d2-a210-a85a2e75e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67108817-a700-46d2-a210-a85a2e75e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-702240309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80319b530df4c0aba192321439691f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:21Z,use_quota=True,user_id='2b5627a9fc40425e908dd39cab08413d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5c9de3-5083-4512-bf20-72f96cdaa33f),volume_type_id=3b5c9de3-5083-4512-bf20-72f96cdaa33f)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f849ad1c-a7d2-40db-85d9-5dd636e37455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f849ad1c-a7d2-40db-85d9-5dd636e37455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17302e5b-1659-4d3e-9a03-aaaabd398a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17302e5b-1659-4d3e-9a03-aaaabd398a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692', 'volume_name': 'volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff14ef8-5b06-4b66-926f-34bcd5aa38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff14ef8-5b06-4b66-926f-34bcd5aa38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809d20e3-9c66-498c-a2ea-ce33679c25ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:21 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Volume 14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692', 'volume_size': 1}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-702240309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80319b530df4c0aba192321439691f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:21Z,use_quota=True,user_id='2b5627a9fc40425e908dd39cab08413d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b5c9de3-5083-4512-bf20-72f96cdaa33f),volume_type_id=3b5c9de3-5083-4512-bf20-72f96cdaa33f)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Creating volume 14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:21 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:21 devstack sudo[97078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 1073741824
Sep 25 17:08:21 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:22 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 1073741824" returned: 0 in 0.554s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:22 devstack sudo[97084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692
Sep 25 17:08:22 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Flow 'volume_create_manager' (571555df-8613-4e87-857d-4a3d4d25f8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:22 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63be6d2d-6406-41be-95a9-52da73c8a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" returned: 0 in 0.301s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63be6d2d-6406-41be-95a9-52da73c8a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1970256644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bab8ae-a50a-48bf-8cbc-0a19b789afbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7a62ecc41949e98c95f05618098b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:22Z,use_quota=True,user_id='52555e5ed3064cde9837371258c2c3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f08271a-6cbc-4c2a-9e4a-6e38fdaf5e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f08271a-6cbc-4c2a-9e4a-6e38fdaf5e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c241f70-ff79-480c-b5a8-9d63f17dc45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c241f70-ff79-480c-b5a8-9d63f17dc45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bab8ae-a50a-48bf-8cbc-0a19b789afbc', 'volume_name': 'volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd41d97-bd3f-425b-896c-6c5bc782dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd41d97-bd3f-425b-896c-6c5bc782dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c483d59e-69ad-4561-81a6-764407ee5103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Volume 93bab8ae-a50a-48bf-8cbc-0a19b789afbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc', 'volume_size': 1}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1970256644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bab8ae-a50a-48bf-8cbc-0a19b789afbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7a62ecc41949e98c95f05618098b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:22Z,use_quota=True,user_id='52555e5ed3064cde9837371258c2c3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Creating volume 93bab8ae-a50a-48bf-8cbc-0a19b789afbc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:22 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809d20e3-9c66-498c-a2ea-ce33679c25ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16482f31-8c41-4e5b-a800-efc95304732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack sudo[97087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc 1073741824
Sep 25 17:08:22 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Volume volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 (14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692): created successfully
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16482f31-8c41-4e5b-a800-efc95304732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Flow 'volume_create_manager' (4031e01b-a431-42d3-89c7-72d08af8f020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7da36060-c662-4c5c-89de-b3852663c3a5 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Created volume successfully.
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Flow 'volume_create_manager' (1265b5cf-3548-4810-bebf-db428a3b0c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da31c297-335e-4aa9-bb62-1a9b6d565c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da31c297-335e-4aa9-bb62-1a9b6d565c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-815171386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723b1f77-ca81-446e-942b-c621ce251691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d363bb96764a3395b8b48a374a63e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:23Z,use_quota=True,user_id='a2d4a45e688a4ad2a411b3d1ad5c5700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b99d7d-91aa-4986-b0b8-7deef6355051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b99d7d-91aa-4986-b0b8-7deef6355051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff78fb5-0f80-4459-8450-c6f5a119362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff78fb5-0f80-4459-8450-c6f5a119362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723b1f77-ca81-446e-942b-c621ce251691', 'volume_name': 'volume-723b1f77-ca81-446e-942b-c621ce251691', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c29aa37-ae04-4d02-a2e9-6edf9ed53bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c29aa37-ae04-4d02-a2e9-6edf9ed53bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c5b488-190d-443e-a6c1-3e12614d83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Volume 723b1f77-ca81-446e-942b-c621ce251691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723b1f77-ca81-446e-942b-c621ce251691', 'volume_size': 1}
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:22 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc 1073741824" returned: 0 in 0.462s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:23 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc
Sep 25 17:08:23 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:23 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" returned: 0 in 0.264s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-815171386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723b1f77-ca81-446e-942b-c621ce251691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d363bb96764a3395b8b48a374a63e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:23Z,use_quota=True,user_id='a2d4a45e688a4ad2a411b3d1ad5c5700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Creating volume 723b1f77-ca81-446e-942b-c621ce251691 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:23 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 1073741824
Sep 25 17:08:23 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c483d59e-69ad-4561-81a6-764407ee5103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9f7d6-3b6d-4ece-aa55-463b4792199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Volume volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc (93bab8ae-a50a-48bf-8cbc-0a19b789afbc): created successfully
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9f7d6-3b6d-4ece-aa55-463b4792199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Flow 'volume_create_manager' (571555df-8613-4e87-857d-4a3d4d25f8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f50c3849-2d8d-4be6-9606-ca36da4e7349 tempest-AttachVolumeShelveTestJSON-1235280520 None] Created volume successfully.
Sep 25 17:08:23 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 1073741824" returned: 0 in 0.578s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:23 devstack sudo[97102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691
Sep 25 17:08:23 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:24 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:24 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:24 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691" returned: 0 in 0.287s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c5b488-190d-443e-a6c1-3e12614d83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723b1f77-ca81-446e-942b-c621ce251691', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a491ec-36c8-45f1-ba04-50ebfb765374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Volume volume-723b1f77-ca81-446e-942b-c621ce251691 (723b1f77-ca81-446e-942b-c621ce251691): created successfully
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a491ec-36c8-45f1-ba04-50ebfb765374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Flow 'volume_create_manager' (1265b5cf-3548-4810-bebf-db428a3b0c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:24 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fb3c7cfd-ae37-4572-98b5-0c9e6d9cfef1 tempest-AbsoluteLimitsTests-1415947608 None] Created volume successfully.
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-706ab44f-74d1-4127-810a-845bf535e428 tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Retype volume completed successfully.
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Acquiring lock "cinder-723b1f77-ca81-446e-942b-c621ce251691-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "cinder-723b1f77-ca81-446e-942b-c621ce251691-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Acquiring lock "cinder-quobyte-723b1f77-ca81-446e-942b-c621ce251691" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "cinder-quobyte-723b1f77-ca81-446e-942b-c621ce251691" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[891dff6d-edbc-4854-a702-2cf7cda02581]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:25 devstack sudo[97112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691
Sep 25 17:08:25 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "cinder-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "cinder-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "cinder-quobyte-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "cinder-quobyte-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca6bd48-4b12-4f26-b145-6a056d1c8982]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:25 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:25 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692
Sep 25 17:08:25 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:25 devstack sudo[97120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691
Sep 25 17:08:25 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:25 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-723b1f77-ca81-446e-942b-c621ce251691" returned: 0 in 0.392s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "cinder-quobyte-723b1f77-ca81-446e-942b-c621ce251691" released by "delete_volume" :: held 0.890s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Created reservations ['2a877c29-1ad1-407d-a8ae-eba7ca6750cb', 'c1b6d6e7-9042-46a0-a56f-ba702c975450', '72bee887-711d-4d5c-8a36-085a9289d15f', 'a1b0d437-1e05-4e0b-873e-37dd402f6449'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:26 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" returned: 0 in 0.600s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:26 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692
Sep 25 17:08:26 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:26 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:26 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:26 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "cinder-quobyte-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692" released by "delete_volume" :: held 1.110s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:26 devstack cinder-volume[86955]: WARNING cinder.quota [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:08:26 devstack cinder-volume[86955]: WARNING cinder.quota [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:08:26 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.430s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Deleted volume successfully.
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Created reservations ['6f5fc992-0602-40ca-a350-d1fb8d92e740', '806e9649-2189-4cec-8ca0-a057f29cae5e', '1daa31fd-7837-4c97-b628-dba8a3416f4b', '78b6c304-df40-49ca-ba8b-b1f5e327c790'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-389e9f02-9055-4a75-93d0-0e3c1b469154 tempest-AbsoluteLimitsTests-1415947608 None] Lock "cinder-723b1f77-ca81-446e-942b-c621ce251691-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:26 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:26 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:27 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.345s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Deleted volume successfully.
Sep 25 17:08:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1182ab5-626b-455b-b9bf-9145ed39fa3e tempest-VolumeRetypeWithoutMigrationTest-1490427992 None] Lock "cinder-14c1da5d-ceb4-49e2-a01b-8fc9e1bd0692-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-370c3aa6-ee3f-4ecd-8f71-cc6b5b2f0f15 req-12a1fb75-8a91-4bed-9b5f-b203459ab7fa tempest-TestMinimumBasicScenario-1972809467 None] Terminate volume connection completed successfully.
Sep 25 17:08:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-370c3aa6-ee3f-4ecd-8f71-cc6b5b2f0f15 req-12a1fb75-8a91-4bed-9b5f-b203459ab7fa tempest-TestMinimumBasicScenario-1972809467 None] Deleting attachment 67142ff8-b40a-4e2f-b715-2f2ccbbcbf46. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "cinder-acf1de19-2d73-474d-8961-aeff882593c8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "cinder-acf1de19-2d73-474d-8961-aeff882593c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "cinder-quobyte-acf1de19-2d73-474d-8961-aeff882593c8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "cinder-quobyte-acf1de19-2d73-474d-8961-aeff882593c8" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d4cb7-aa07-4e40-954f-f010e41dc4ae]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:31 devstack sudo[97201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8
Sep 25 17:08:31 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:32 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8" returned: 0 in 0.490s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:32 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8
Sep 25 17:08:32 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:32 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-acf1de19-2d73-474d-8961-aeff882593c8" returned: 0 in 0.373s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "cinder-quobyte-acf1de19-2d73-474d-8961-aeff882593c8" released by "delete_volume" :: held 0.950s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Created reservations ['4d54545a-b485-42b0-b945-9bea4fe7ddbc', '5ad1c3bc-9443-4192-a6c6-ad4ef9dcf354', 'b2c0b604-551f-4edb-9126-df59dc2d7ec6', '8276928d-a1f2-4d7b-b80d-7c2d75fe07a7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:33 devstack sudo[97217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:33 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:33 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Deleted volume successfully.
Sep 25 17:08:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d25e2bd6-1656-410f-9e23-be049dd5f896 tempest-TestMinimumBasicScenario-1972809467 None] Lock "cinder-acf1de19-2d73-474d-8961-aeff882593c8-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Flow 'volume_create_manager' (cb30680d-95d5-4bec-ad46-cea1d4176cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6296090-3a8d-4665-b79f-ae0d0f6cd9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6296090-3a8d-4665-b79f-ae0d0f6cd9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-374866201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c597fe-8ab7-4d88-baaa-a693cc638509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0a2d7a3bd40df93c17ac58d9695a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:35Z,use_quota=True,user_id='b450f78c5b534913ab1d0561dd8a0de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a46251d-daae-4e64-a9b0-a08d5862f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a46251d-daae-4e64-a9b0-a08d5862f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee75b0a8-15a0-4bf4-8f77-5cfdef239f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee75b0a8-15a0-4bf4-8f77-5cfdef239f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c597fe-8ab7-4d88-baaa-a693cc638509', 'volume_name': 'volume-00c597fe-8ab7-4d88-baaa-a693cc638509', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7affb-f1b9-4b2b-bcb6-ad15a4f0a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7affb-f1b9-4b2b-bcb6-ad15a4f0a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82528d9-2a29-4791-8e31-5d8179275ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Volume 00c597fe-8ab7-4d88-baaa-a693cc638509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c597fe-8ab7-4d88-baaa-a693cc638509', 'volume_size': 1}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-374866201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c597fe-8ab7-4d88-baaa-a693cc638509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a0a2d7a3bd40df93c17ac58d9695a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:35Z,use_quota=True,user_id='b450f78c5b534913ab1d0561dd8a0de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Creating volume 00c597fe-8ab7-4d88-baaa-a693cc638509 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:35 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:35 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 1073741824
Sep 25 17:08:35 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:35 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 1073741824" returned: 0 in 0.598s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:35 devstack sudo[97268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509
Sep 25 17:08:35 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:36 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509" returned: 0 in 0.449s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82528d9-2a29-4791-8e31-5d8179275ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c597fe-8ab7-4d88-baaa-a693cc638509', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d480241f-c05b-4a3d-bdc5-7c2229ecc727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Volume volume-00c597fe-8ab7-4d88-baaa-a693cc638509 (00c597fe-8ab7-4d88-baaa-a693cc638509): created successfully
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d480241f-c05b-4a3d-bdc5-7c2229ecc727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Flow 'volume_create_manager' (cb30680d-95d5-4bec-ad46-cea1d4176cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ccbc0910-6e92-48e3-b57b-113888111d3d tempest-VolumesMetadataTest-290837188 None] Created volume successfully.
Sep 25 17:08:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-c1137492-a69e-471a-b150-488df1106fc5 req-312b8b6f-674d-4f00-9bb3-09d6b88fb240 tempest-AttachVolumeShelveTestJSON-1235280520 None] No connector for attachment 57274e30-f3c1-45e8-8303-8ba4a20675c8; skipping storage backend terminate_connection call. {{(pid=86955) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 25 17:08:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-c1137492-a69e-471a-b150-488df1106fc5 req-312b8b6f-674d-4f00-9bb3-09d6b88fb240 tempest-AttachVolumeShelveTestJSON-1235280520 None] Deleting attachment 57274e30-f3c1-45e8-8303-8ba4a20675c8. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Acquiring lock "cinder-00c597fe-8ab7-4d88-baaa-a693cc638509-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "cinder-00c597fe-8ab7-4d88-baaa-a693cc638509-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Acquiring lock "cinder-quobyte-00c597fe-8ab7-4d88-baaa-a693cc638509" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "cinder-quobyte-00c597fe-8ab7-4d88-baaa-a693cc638509" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04f0c3-32d7-45f5-8a55-b6eea755bd5d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:38 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509
Sep 25 17:08:38 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:38 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509" returned: 0 in 0.441s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:38 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509
Sep 25 17:08:38 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:39 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00c597fe-8ab7-4d88-baaa-a693cc638509" returned: 0 in 0.319s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "cinder-quobyte-00c597fe-8ab7-4d88-baaa-a693cc638509" released by "delete_volume" :: held 0.822s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Created reservations ['b7e4722d-99e2-4130-9573-467ddfe47132', 'a3be6616-0cef-4917-a4ed-179f5398f2dc', '111b6442-7d00-449e-8b15-fd1535d9dc9a', 'b350593a-c4c4-41e5-9019-aec93ee45c93'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:39 devstack sudo[97286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:39 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:39 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Deleted volume successfully.
Sep 25 17:08:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c6d9de1a-c02e-4666-8c5e-df651093c9ea tempest-VolumesMetadataTest-290837188 None] Lock "cinder-00c597fe-8ab7-4d88-baaa-a693cc638509-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (1b2cc49c-6f77-4255-8d86-4a2ce3c7f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f420484e-5648-4ccb-89c5-0c772be9b9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f420484e-5648-4ccb-89c5-0c772be9b9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1840860685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79676822-98b7-438a-86d8-cfa23f07013d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:46Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a046e1-de57-4a55-bcb9-86b0dd9667e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a046e1-de57-4a55-bcb9-86b0dd9667e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba664b-87b5-4e1a-af8c-a5cc985d7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba664b-87b5-4e1a-af8c-a5cc985d7284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79676822-98b7-438a-86d8-cfa23f07013d', 'volume_name': 'volume-79676822-98b7-438a-86d8-cfa23f07013d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e97037d-becd-49b6-b2b0-eaffcf49a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e97037d-becd-49b6-b2b0-eaffcf49a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ea0e0-35a4-4ad9-8a67-e1c33488338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Volume 79676822-98b7-438a-86d8-cfa23f07013d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79676822-98b7-438a-86d8-cfa23f07013d', 'volume_size': 1}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1840860685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79676822-98b7-438a-86d8-cfa23f07013d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:46Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Creating volume 79676822-98b7-438a-86d8-cfa23f07013d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:46 devstack sudo[97294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d 1073741824
Sep 25 17:08:46 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:47 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d 1073741824" returned: 0 in 0.837s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:47 devstack sudo[97300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d
Sep 25 17:08:47 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:47 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d" returned: 0 in 0.312s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ea0e0-35a4-4ad9-8a67-e1c33488338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79676822-98b7-438a-86d8-cfa23f07013d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974dffdb-2d79-4c6f-a9ce-26667113f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Volume volume-79676822-98b7-438a-86d8-cfa23f07013d (79676822-98b7-438a-86d8-cfa23f07013d): created successfully
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974dffdb-2d79-4c6f-a9ce-26667113f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (1b2cc49c-6f77-4255-8d86-4a2ce3c7f46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0a37850b-5867-4f2f-99f9-655f7dca5366 tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Flow 'volume_create_manager' (cdbf4ffa-dc52-4bb3-ba30-44cff92e4110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a182f5f-39dc-49fc-9666-7be423fb464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a182f5f-39dc-49fc-9666-7be423fb464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1620298646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd4b80d-2368-431e-8409-e9dbf995c1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f7f34b13cf467dbe90775e573c8119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:49Z,use_quota=True,user_id='d32294a795bd4e378ece6a364696459b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ed056a0-ae2f-48dd-8b54-d8a56719a5e5),volume_type_id=4ed056a0-ae2f-48dd-8b54-d8a56719a5e5)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df14800e-d0e3-4ec3-8044-a692d61382ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df14800e-d0e3-4ec3-8044-a692d61382ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46ed3f4-7c0f-4958-bf3c-d008595cf5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46ed3f4-7c0f-4958-bf3c-d008595cf5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd4b80d-2368-431e-8409-e9dbf995c1d0', 'volume_name': 'volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bb7db4-cc1b-496c-a2a4-29845ce7bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bb7db4-cc1b-496c-a2a4-29845ce7bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44555ce-806d-4d34-a4ec-9e27b1cca06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Volume 5fd4b80d-2368-431e-8409-e9dbf995c1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0', 'volume_size': 1}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1620298646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd4b80d-2368-431e-8409-e9dbf995c1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10f7f34b13cf467dbe90775e573c8119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:49Z,use_quota=True,user_id='d32294a795bd4e378ece6a364696459b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ed056a0-ae2f-48dd-8b54-d8a56719a5e5),volume_type_id=4ed056a0-ae2f-48dd-8b54-d8a56719a5e5)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Creating volume 5fd4b80d-2368-431e-8409-e9dbf995c1d0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:48 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:48 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 1073741824
Sep 25 17:08:48 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (7c3e10b0-9fbf-4c63-8b91-50f931810752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf688654-3a56-49df-afcf-64924d957dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 1073741824" returned: 0 in 0.688s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf688654-3a56-49df-afcf-64924d957dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-875451497',display_name='tempest-VolumesGetTest-Volume-1933258526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4aae12-d5ce-498d-a935-4912cabcb1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:49Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbe4279-ed41-43af-b683-c581bdb7dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbe4279-ed41-43af-b683-c581bdb7dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c241a0-0518-47dc-8b6a-e320bf9992d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c241a0-0518-47dc-8b6a-e320bf9992d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4aae12-d5ce-498d-a935-4912cabcb1f6', 'volume_name': 'volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9099a56-2fe2-436c-b3bb-91bb725ccebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9099a56-2fe2-436c-b3bb-91bb725ccebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cf63e5-448c-4d1c-ae84-b14b939d3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Volume 4d4aae12-d5ce-498d-a935-4912cabcb1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6', 'volume_size': 1}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:49 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0
Sep 25 17:08:49 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:49 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-875451497',display_name='tempest-VolumesGetTest-Volume-1933258526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4aae12-d5ce-498d-a935-4912cabcb1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:49Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Creating volume 4d4aae12-d5ce-498d-a935-4912cabcb1f6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44555ce-806d-4d34-a4ec-9e27b1cca06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack sudo[97348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 1073741824
Sep 25 17:08:49 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb9ae2b-51d0-431e-860f-df72fdb978c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Volume volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 (5fd4b80d-2368-431e-8409-e9dbf995c1d0): created successfully
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb9ae2b-51d0-431e-860f-df72fdb978c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Flow 'volume_create_manager' (cdbf4ffa-dc52-4bb3-ba30-44cff92e4110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e528461-9360-44ba-abf4-2b70e1c387dd tempest-VolumeTypesAccessTest-733170686 None] Created volume successfully.
Sep 25 17:08:50 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 1073741824" returned: 0 in 0.617s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:50 devstack sudo[97355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6
Sep 25 17:08:50 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Acquiring lock "cinder-5fd4b80d-2368-431e-8409-e9dbf995c1d0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "cinder-5fd4b80d-2368-431e-8409-e9dbf995c1d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:50 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6" returned: 0 in 0.492s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Acquiring lock "cinder-quobyte-5fd4b80d-2368-431e-8409-e9dbf995c1d0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cf63e5-448c-4d1c-ae84-b14b939d3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea0672b-0714-446b-beaa-0c39d9b2abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "cinder-quobyte-5fd4b80d-2368-431e-8409-e9dbf995c1d0" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Volume volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 (4d4aae12-d5ce-498d-a935-4912cabcb1f6): created successfully
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea0672b-0714-446b-beaa-0c39d9b2abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (7c3e10b0-9fbf-4c63-8b91-50f931810752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726d2b4-8ada-45b8-b4f5-9e25fa566191]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1954d40e-0110-4f3e-b40a-c21e4c04bee1 tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:08:51 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0
Sep 25 17:08:51 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:51 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0" returned: 0 in 0.633s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:51 devstack sudo[97395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0
Sep 25 17:08:51 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-4d4aae12-d5ce-498d-a935-4912cabcb1f6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "cinder-4d4aae12-d5ce-498d-a935-4912cabcb1f6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-4d4aae12-d5ce-498d-a935-4912cabcb1f6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-4d4aae12-d5ce-498d-a935-4912cabcb1f6" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf40c71-b897-48b7-ab93-39891562573a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:52 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5fd4b80d-2368-431e-8409-e9dbf995c1d0" returned: 0 in 0.510s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "cinder-quobyte-5fd4b80d-2368-431e-8409-e9dbf995c1d0" released by "delete_volume" :: held 1.229s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:52 devstack cinder-volume[86955]: WARNING cinder.quota [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-984457756 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-984457756, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:08:52 devstack cinder-volume[86955]: WARNING cinder.quota [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-984457756 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-984457756, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:08:52 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6
Sep 25 17:08:52 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Created reservations ['58b8816e-bd1a-44ae-9a41-fe284a56ee63', 'a79b9b51-3549-421b-b04b-39f35dd5bed6', '784a85e2-6710-488d-ad26-8f5f67bc491e', 'df1c9176-aee2-4dc8-ad23-a9d1a78ff1a4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:52 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:52 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:52 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:52 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6
Sep 25 17:08:52 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:53 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Deleted volume successfully.
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c92a181-2ee0-40d6-a844-ee79017c5ddf tempest-VolumeTypesAccessTest-733170686 None] Lock "cinder-5fd4b80d-2368-431e-8409-e9dbf995c1d0-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:53 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4d4aae12-d5ce-498d-a935-4912cabcb1f6" returned: 0 in 0.360s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-4d4aae12-d5ce-498d-a935-4912cabcb1f6" released by "delete_volume" :: held 1.231s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Created reservations ['b0252ff8-5ce2-4cff-8845-356a03d0693b', '8cef047d-1362-4756-a653-bcdb1d0b619e', '292f2919-df42-4a2e-b91f-2c4ad787fe74', '0beabe27-899c-4659-8656-0ff5943257b3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:53 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:53 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:53 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:08:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-616bb9c5-976d-4a2b-bd56-0281c0d432c0 tempest-VolumesGetTest-467551785 None] Lock "cinder-4d4aae12-d5ce-498d-a935-4912cabcb1f6-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-79676822-98b7-438a-86d8-cfa23f07013d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "cinder-79676822-98b7-438a-86d8-cfa23f07013d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-79676822-98b7-438a-86d8-cfa23f07013d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-79676822-98b7-438a-86d8-cfa23f07013d" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb62e1-a7a6-4efb-b254-d5624ce5a172]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:08:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:55 devstack sudo[97465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d
Sep 25 17:08:55 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:55 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:55 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d
Sep 25 17:08:55 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:55 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79676822-98b7-438a-86d8-cfa23f07013d" returned: 0 in 0.321s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-79676822-98b7-438a-86d8-cfa23f07013d" released by "delete_volume" :: held 1.104s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:55 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Created reservations ['8d3caaa9-d1fe-4bfa-89f9-00b4afbed66c', '7e4c6b42-9f96-4a04-80b0-9f3f89a7078a', 'd8b80a3c-4cc1-4acd-a208-d073494b80e7', 'ab337f8d-c480-4abc-997f-c42bab4be51d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:56 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:08:56 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:56 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:08:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:08:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d90c903e-c9ee-4288-937e-c428b633305a tempest-VolumesGetTest-467551785 None] Lock "cinder-79676822-98b7-438a-86d8-cfa23f07013d-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (aef378bc-f14a-4c8a-b947-b2043f60b8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad36977-2ce4-479f-a31b-a05f3fa58d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad36977-2ce4-479f-a31b-a05f3fa58d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-956679891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb77050c-0ac3-4a91-b987-d58dd297bb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:58Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374c5b3f-da47-4887-b9fe-fd9dee7ae10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374c5b3f-da47-4887-b9fe-fd9dee7ae10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3ebdb-fe3f-46e6-b1ca-e7a1b189123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3ebdb-fe3f-46e6-b1ca-e7a1b189123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb77050c-0ac3-4a91-b987-d58dd297bb08', 'volume_name': 'volume-cb77050c-0ac3-4a91-b987-d58dd297bb08', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ef8c75-379e-42e3-9a60-cf64b5f887fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ef8c75-379e-42e3-9a60-cf64b5f887fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07387b2-08af-4849-b06a-5aab76246917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Volume cb77050c-0ac3-4a91-b987-d58dd297bb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb77050c-0ac3-4a91-b987-d58dd297bb08', 'volume_size': 1}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-956679891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb77050c-0ac3-4a91-b987-d58dd297bb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:58Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Creating volume cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:08:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:58 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 1073741824
Sep 25 17:08:58 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:58 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 1073741824" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=94,cinder:SELECT=80,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=54,cinder:INSERT=18,cinder:UPDATE=94,cinder:DELETE=9 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:08:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:08:58 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:08:58 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:08:59 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07387b2-08af-4849-b06a-5aab76246917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb77050c-0ac3-4a91-b987-d58dd297bb08', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9e58c9-06cb-45e1-8b5b-c9d0dd31076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:08:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Volume volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 (cb77050c-0ac3-4a91-b987-d58dd297bb08): created successfully
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9e58c9-06cb-45e1-8b5b-c9d0dd31076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:08:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (aef378bc-f14a-4c8a-b947-b2043f60b8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:08:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b5ba36a5-86d1-4fee-ad42-0908ef0c25cb tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (e2e41439-6edd-4ebc-9e0c-fe3d1b817cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd91c484-e510-4ec7-b246-1a391db9240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd91c484-e510-4ec7-b246-1a391db9240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-236258149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548e0f16-037a-4316-a3f7-755d38b48b65,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cb77050c-0ac3-4a91-b987-d58dd297bb08,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:01Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e1345b-8346-482a-948a-a65b18c8a14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e1345b-8346-482a-948a-a65b18c8a14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefbd141-1549-433d-9396-ebcbd1110472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eefbd141-1549-433d-9396-ebcbd1110472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '548e0f16-037a-4316-a3f7-755d38b48b65', 'volume_name': 'volume-548e0f16-037a-4316-a3f7-755d38b48b65', 'volume_size': 1, 'source_volid': 'cb77050c-0ac3-4a91-b987-d58dd297bb08', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93e12ca-0c7f-447d-b9a5-30108bf1bd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93e12ca-0c7f-447d-b9a5-30108bf1bd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880288fa-4671-448e-9fa8-01e406237da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Volume 548e0f16-037a-4316-a3f7-755d38b48b65: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-548e0f16-037a-4316-a3f7-755d38b48b65', 'volume_size': 1, 'source_volid': 'cb77050c-0ac3-4a91-b987-d58dd297bb08', 'source_volstatus': 'available'}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Cloning volume cb77050c-0ac3-4a91-b987-d58dd297bb08 to volume 548e0f16-037a-4316-a3f7-755d38b48b65
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Creating offline snapshot 570b9392-e4dc-4bd5-bea8-aee89e3b6df5 of volume cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba44b09-bc10-43f7-a84e-0ffc97741ed2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:01 devstack sudo[97487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:09:01 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:01 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:01 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 1G
Sep 25 17:09:01 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:02 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 1G" returned: 0 in 0.578s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:02 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:02 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:02 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:02 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 is being set with open permissions: ugo+rw
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:02 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:02 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:02 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.312s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:02 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info
Sep 25 17:09:02 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:03 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info" returned: 0 in 0.553s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info is being set with open permissions: ugo+rw
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:03 devstack sudo[97510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info
Sep 25 17:09:03 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:03 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:03 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:04 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.549s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:09:04 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.info" returned: 0 in 0.747s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] snapshot: 570b9392-e4dc-4bd5-bea8-aee89e3b6df5, volume: 548e0f16-037a-4316-a3f7-755d38b48b65,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d5d6d9-8aeb-4e7e-9ecf-aa4c3155cf89]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:04 devstack sudo[97516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:04 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:04 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.613s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb77050c-0ac3-4a91-b987-d58dd297bb08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f5c57-4455-4e7a-a69d-ef06d984d3a7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:05 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:09:05 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:05 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.622s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:09:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:05 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65
Sep 25 17:09:05 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:12 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:09:12 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:09:13 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65" returned: 0 in 8.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:13 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:09:13 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Converted 1024.00 MB image at 123.20 MB/s
Sep 25 17:09:13 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 is being set with open permissions: ugo+rw
Sep 25 17:09:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:13 devstack sudo[97548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65
Sep 25 17:09:13 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:14 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65" returned: 0 in 0.468s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" released by "_copy_volume_from_snapshot" :: held 10.122s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-570b9392-e4dc-4bd5-bea8-aee89e3b6df5" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-570b9392-e4dc-4bd5-bea8-aee89e3b6df5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Deleting offline snapshot 570b9392-e4dc-4bd5-bea8-aee89e3b6df5 of volume cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] snapshot_file for this snap is: volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0db489-5540-41a4-96d8-ea055427d4ea]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:14 devstack sudo[97551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:14 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:15 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.704s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb77050c-0ac3-4a91-b987-d58dd297bb08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:09:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177b905-c32e-44df-b3b0-97b8aacd4cde]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:15 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:09:15 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:16 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.796s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:16 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:16 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:16 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:16 devstack sudo[97601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5
Sep 25 17:09:16 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:17 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08.570b9392-e4dc-4bd5-bea8-aee89e3b6df5" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-570b9392-e4dc-4bd5-bea8-aee89e3b6df5" released by "_delete_snapshot" :: held 2.747s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.393s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880288fa-4671-448e-9fa8-01e406237da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548e0f16-037a-4316-a3f7-755d38b48b65', 'volume_size': 1, 'source_volid': 'cb77050c-0ac3-4a91-b987-d58dd297bb08', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a9fa7e-5047-4c6f-9fa3-3d48badd0ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Volume volume-548e0f16-037a-4316-a3f7-755d38b48b65 (548e0f16-037a-4316-a3f7-755d38b48b65): created successfully
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a9fa7e-5047-4c6f-9fa3-3d48badd0ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (e2e41439-6edd-4ebc-9e0c-fe3d1b817cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3f27661f-ea8c-40a2-86a4-9aa958d03900 tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (6640cfa4-def9-4f3d-9bd0-43f7be0e8729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a0f278-8718-4de9-9d24-b1488af4a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a0f278-8718-4de9-9d24-b1488af4a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-496325461',display_name='tempest-VolumesGetTest-Volume-1174903863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1defcd8b-f4bd-4bb5-a008-64b8409115f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:19Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730837ad-9725-4e97-a601-7559e4e01cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730837ad-9725-4e97-a601-7559e4e01cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f0e4fd-8f94-435d-b6e6-cec7a28a024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f0e4fd-8f94-435d-b6e6-cec7a28a024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1defcd8b-f4bd-4bb5-a008-64b8409115f0', 'volume_name': 'volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704009f0-f74d-4b7e-b9f2-1293a530cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704009f0-f74d-4b7e-b9f2-1293a530cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dca765-de6c-45c8-b8e2-75394601593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Volume 1defcd8b-f4bd-4bb5-a008-64b8409115f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0', 'volume_size': 1}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-496325461',display_name='tempest-VolumesGetTest-Volume-1174903863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1defcd8b-f4bd-4bb5-a008-64b8409115f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:19Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Creating volume 1defcd8b-f4bd-4bb5-a008-64b8409115f0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:18 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 1073741824
Sep 25 17:09:18 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:19 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 1073741824" returned: 0 in 0.579s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:19 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0
Sep 25 17:09:19 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:19 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0" returned: 0 in 0.396s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dca765-de6c-45c8-b8e2-75394601593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca487c7-aa55-4544-aeca-ab897139c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Volume volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 (1defcd8b-f4bd-4bb5-a008-64b8409115f0): created successfully
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca487c7-aa55-4544-aeca-ab897139c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (6640cfa4-def9-4f3d-9bd0-43f7be0e8729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e7168d53-5d9e-47f0-b23b-9e0165d29d7e tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:09:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-1defcd8b-f4bd-4bb5-a008-64b8409115f0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "cinder-1defcd8b-f4bd-4bb5-a008-64b8409115f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-1defcd8b-f4bd-4bb5-a008-64b8409115f0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-1defcd8b-f4bd-4bb5-a008-64b8409115f0" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[253072c9-0083-4c38-9319-33c7e595cd19]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:21 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0
Sep 25 17:09:21 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0" returned: 0 in 0.454s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:21 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0
Sep 25 17:09:21 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:21 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1defcd8b-f4bd-4bb5-a008-64b8409115f0" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-1defcd8b-f4bd-4bb5-a008-64b8409115f0" released by "delete_volume" :: held 0.795s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Created reservations ['0ac659de-f013-47f9-af79-37fd3c29de04', '0d3cedf3-4c9b-4406-93f7-079b72ba098b', '2eaf66c3-a661-407a-a52f-37267afcb6ce', '646c18fb-0b04-4603-9ce3-a37c420602bc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:22 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:22 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-548e0f16-037a-4316-a3f7-755d38b48b65-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "cinder-548e0f16-037a-4316-a3f7-755d38b48b65-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f17eff-9b96-4b54-9695-4a686bcca4ff]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:22 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.394s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b096e33d-3d43-4414-9543-df4189ae5388 tempest-VolumesGetTest-467551785 None] Lock "cinder-1defcd8b-f4bd-4bb5-a008-64b8409115f0-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:22 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65
Sep 25 17:09:22 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:22 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65" returned: 0 in 0.466s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:22 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65
Sep 25 17:09:22 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:23 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Acquiring lock "cinder-93bab8ae-a50a-48bf-8cbc-0a19b789afbc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-548e0f16-037a-4316-a3f7-755d38b48b65" returned: 0 in 0.424s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-548e0f16-037a-4316-a3f7-755d38b48b65" released by "delete_volume" :: held 0.972s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "cinder-93bab8ae-a50a-48bf-8cbc-0a19b789afbc-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Acquiring lock "cinder-quobyte-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Created reservations ['22070c0e-8dc3-411c-b497-359190047a68', '18693396-24e5-498c-9d58-e23c623c0527', 'fc287488-e2bd-4c4c-8438-26aeb3795316', '5a117768-6602-4567-bbc2-9877bf522209'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "cinder-quobyte-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566764e-336c-4a31-9a46-18bfba578e66]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:23 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:23 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:23 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc
Sep 25 17:09:23 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:23 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.323s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e12996aa-7539-44bb-aede-431c7898b15a tempest-VolumesGetTest-467551785 None] Lock "cinder-548e0f16-037a-4316-a3f7-755d38b48b65-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:23 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" returned: 0 in 0.582s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:24 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc
Sep 25 17:09:24 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:24 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "cinder-quobyte-93bab8ae-a50a-48bf-8cbc-0a19b789afbc" released by "delete_volume" :: held 0.947s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Created reservations ['adfb96bd-ce44-4a79-9d3e-823420c9ac6c', '530b0646-2405-45c7-a586-f2c88b95194a', '4858dcfd-0903-4f38-95bd-0a4c4435fc88', '9992bf11-aa9f-4137-b67f-b9e1e163edd4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:24 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:24 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-cb77050c-0ac3-4a91-b987-d58dd297bb08-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "cinder-cb77050c-0ac3-4a91-b987-d58dd297bb08-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-cb77050c-0ac3-4a91-b987-d58dd297bb08" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-cb77050c-0ac3-4a91-b987-d58dd297bb08" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b9ebf-16e5-4488-a983-b2706f0ce199]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:24 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.441s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Deleted volume successfully.
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d131e617-cf97-48a6-a0ae-244947a83ee7 tempest-AttachVolumeShelveTestJSON-1235280520 None] Lock "cinder-93bab8ae-a50a-48bf-8cbc-0a19b789afbc-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:25 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:09:25 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:25 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.524s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:25 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08
Sep 25 17:09:25 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:25 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb77050c-0ac3-4a91-b987-d58dd297bb08" returned: 0 in 0.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-cb77050c-0ac3-4a91-b987-d58dd297bb08" released by "delete_volume" :: held 0.945s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Created reservations ['3b83535b-1cda-4aec-b1d6-9506b846de16', 'debc2985-3e16-4911-ba0a-ae5ded783219', '02fd247f-70c2-41a0-8829-10d417f0e694', '84b6cfeb-022a-4dd8-bf43-f6aa3ec61da9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:25 devstack sudo[97660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:25 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:26 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:26 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:09:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-592706a4-5045-46f3-937b-94066f016aad tempest-VolumesGetTest-467551785 None] Lock "cinder-cb77050c-0ac3-4a91-b987-d58dd297bb08-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (705bc7f5-aeb8-4ba5-ac49-1162d4e3ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81000f2-fda5-4fd1-b349-aeb6d5209c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81000f2-fda5-4fd1-b349-aeb6d5209c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-215660084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:28Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d645b53a-9945-42b3-8fba-29cad1f320b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d645b53a-9945-42b3-8fba-29cad1f320b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11060149-b34c-4406-acfa-cf9b5da4538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:27 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:09:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11060149-b34c-4406-acfa-cf9b5da4538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df', 'volume_name': 'volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4807c90d0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c359a0-e508-464d-ad1a-b2b688380487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c359a0-e508-464d-ad1a-b2b688380487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b55c82-2032-4bc9-a5d7-422cfd3d5eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4807c90d0>}
Sep 25 17:09:28 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Trying to clone ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df from image 21fcf20c-2aec-48a7-986a-08b11deee77e at location (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:09:29 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3801ab18-77c8-489a-a870-234ab67fe3d3]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:29 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD
Sep 25 17:09:29 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:29 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e is fetched for user 569a20c6cbb142e58b54cfe76d7c940a. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Flow 'volume_create_manager' (ba6f2c7c-9995-4f1b-8632-1e075867449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7248857c-8d6d-4244-ad6b-f35679e8bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7248857c-8d6d-4244-ad6b-f35679e8bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-868867938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76ef61e-4809-432a-b286-7271895d01a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01520746b6d1475a97f7eb8b25299aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='a73cf843661242ea92680eaacb6101f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114a9d02-1f7e-4cbe-9b5b-a4014158baa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114a9d02-1f7e-4cbe-9b5b-a4014158baa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed75fd89-d028-44f4-b1b9-86dbb64f94c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed75fd89-d028-44f4-b1b9-86dbb64f94c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f76ef61e-4809-432a-b286-7271895d01a1', 'volume_name': 'volume-f76ef61e-4809-432a-b286-7271895d01a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be900440-2080-49e6-9756-2c74b95ac331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be900440-2080-49e6-9756-2c74b95ac331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e43b89e-dd5d-4364-a47f-aa519fab999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume f76ef61e-4809-432a-b286-7271895d01a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f76ef61e-4809-432a-b286-7271895d01a1', 'volume_size': 1}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-868867938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76ef61e-4809-432a-b286-7271895d01a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01520746b6d1475a97f7eb8b25299aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='a73cf843661242ea92680eaacb6101f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Creating volume f76ef61e-4809-432a-b286-7271895d01a1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:29 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:29 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 1073741824
Sep 25 17:09:29 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd05b4-a04b-4184-8fca-e56b39e0a36a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:30 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD
Sep 25 17:09:30 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Flow 'volume_create_manager' (38dad5ad-c080-4566-b918-ab5ebb0456c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf66338d-11c8-4be7-9174-0efcf1b795e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf66338d-11c8-4be7-9174-0efcf1b795e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-279206074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b46f57b-0228-4002-9597-6ea3eef7751f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01520746b6d1475a97f7eb8b25299aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='a73cf843661242ea92680eaacb6101f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a192ebf-a6f2-4c27-b599-fd981dc12c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a192ebf-a6f2-4c27-b599-fd981dc12c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7732d3f-975d-44ce-83cd-391331599666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7732d3f-975d-44ce-83cd-391331599666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b46f57b-0228-4002-9597-6ea3eef7751f', 'volume_name': 'volume-3b46f57b-0228-4002-9597-6ea3eef7751f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed778d6-bc8c-4988-ad10-ffb1b860ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed778d6-bc8c-4988-ad10-ffb1b860ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d64e5c9-f414-46e3-b11a-2836a640c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume 3b46f57b-0228-4002-9597-6ea3eef7751f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b46f57b-0228-4002-9597-6ea3eef7751f', 'volume_size': 1}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:30 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:30 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 1073741824" returned: 0 in 0.662s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:30 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1
Sep 25 17:09:30 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:30 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1" returned: 0 in 0.289s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-279206074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b46f57b-0228-4002-9597-6ea3eef7751f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01520746b6d1475a97f7eb8b25299aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='a73cf843661242ea92680eaacb6101f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Creating volume 3b46f57b-0228-4002-9597-6ea3eef7751f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e43b89e-dd5d-4364-a47f-aa519fab999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76ef61e-4809-432a-b286-7271895d01a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4056b5ab-d445-4ea3-8d09-fbbbf34f45ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:30 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f 1073741824
Sep 25 17:09:30 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume volume-f76ef61e-4809-432a-b286-7271895d01a1 (f76ef61e-4809-432a-b286-7271895d01a1): created successfully
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4056b5ab-d445-4ea3-8d09-fbbbf34f45ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Flow 'volume_create_manager' (ba6f2c7c-9995-4f1b-8632-1e075867449e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e5315e42-104f-440e-8b0a-0cf263e1c0de tempest-TestServerVolumeAttachmentScenario-1526305542 None] Created volume successfully.
Sep 25 17:09:31 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f 1073741824" returned: 0 in 0.488s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:31 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f
Sep 25 17:09:31 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:31 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-215660084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:28Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Creating volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:31 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d64e5c9-f414-46e3-b11a-2836a640c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b46f57b-0228-4002-9597-6ea3eef7751f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:31 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1073741824
Sep 25 17:09:31 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a58623-6e8c-4e70-9c7c-423b3d8a278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Volume volume-3b46f57b-0228-4002-9597-6ea3eef7751f (3b46f57b-0228-4002-9597-6ea3eef7751f): created successfully
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a58623-6e8c-4e70-9c7c-423b3d8a278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Flow 'volume_create_manager' (38dad5ad-c080-4566-b918-ab5ebb0456c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d42cb46b-b1fd-4972-9002-626dbe4d25f9 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Created volume successfully.
Sep 25 17:09:32 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1073741824" returned: 0 in 0.599s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:32 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df
Sep 25 17:09:32 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:32 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" returned: 0 in 0.307s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Attempting download of 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20bf88-3a4b-42ea-835e-bb8fae7cb5b0]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:32 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl
Sep 25 17:09:32 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:33 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl" returned: 0 in 0.350s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:33 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl
Sep 25 17:09:33 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:33 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl" returned: 1 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_7ltykwxl' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c553eff-a6a9-44c8-a87c-87b726549701]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:33 devstack sudo[97754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD
Sep 25 17:09:33 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:34 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:34 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] 21fcf20c-2aec-48a7-986a-08b11deee77e was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:09:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:34 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df
Sep 25 17:09:34 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:37 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" returned: 0 in 2.787s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_swiyz3zfdevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:09:37 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Converted 112.00 MB image at 40.16 MB/s
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:37 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1G
Sep 25 17:09:37 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:37 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df 1G" returned: 0 in 0.441s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Downloaded image 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e for user 569a20c6cbb142e58b54cfe76d7c940a is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Marking volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Copying metadata from image 21fcf20c-2aec-48a7-986a-08b11deee77e to ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Creating volume glance metadata for volume ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df backed by image 21fcf20c-2aec-48a7-986a-08b11deee77e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b55c82-2032-4bc9-a5d7-422cfd3d5eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4807c90d0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3769846-3a30-4b2f-b3a8-384b9158faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Volume volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df (ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df): created successfully
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3769846-3a30-4b2f-b3a8-384b9158faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (705bc7f5-aeb8-4ba5-ac49-1162d4e3ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1369ff9a-770c-414c-8d28-4ff717634c06 tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (2bcfb140-c1ca-4f0b-9890-ea97f3eca85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe586965-24d1-4701-b3b2-c36c6dde2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe586965-24d1-4701-b3b2-c36c6dde2dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993168629',display_name='tempest-VolumesGetTest-Volume-1776771427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8315143-4fc6-44db-a285-a0df54b20268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:40Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374366d6-2a05-4e34-af89-87bac644a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374366d6-2a05-4e34-af89-87bac644a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1659991-be66-453a-a606-b4190ab8dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1659991-be66-453a-a606-b4190ab8dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8315143-4fc6-44db-a285-a0df54b20268', 'volume_name': 'volume-d8315143-4fc6-44db-a285-a0df54b20268', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597ce22b-b988-4b1e-a93a-935ed843aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597ce22b-b988-4b1e-a93a-935ed843aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639fe39-4167-4903-bf6e-525dcec047f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Volume d8315143-4fc6-44db-a285-a0df54b20268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8315143-4fc6-44db-a285-a0df54b20268', 'volume_size': 1}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993168629',display_name='tempest-VolumesGetTest-Volume-1776771427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8315143-4fc6-44db-a285-a0df54b20268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921ce721eb5244fcbda3e2dc49bef695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:40Z,use_quota=True,user_id='569a20c6cbb142e58b54cfe76d7c940a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Creating volume d8315143-4fc6-44db-a285-a0df54b20268 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:39 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 1073741824
Sep 25 17:09:39 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:40 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 1073741824" returned: 0 in 0.570s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:40 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268
Sep 25 17:09:40 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:40 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639fe39-4167-4903-bf6e-525dcec047f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8315143-4fc6-44db-a285-a0df54b20268', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df567dda-980c-4057-9f59-f0d39aed810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Volume volume-d8315143-4fc6-44db-a285-a0df54b20268 (d8315143-4fc6-44db-a285-a0df54b20268): created successfully
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df567dda-980c-4057-9f59-f0d39aed810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Flow 'volume_create_manager' (2bcfb140-c1ca-4f0b-9890-ea97f3eca85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6fb26380-027c-41a6-aab8-1aa6a7a2f208 tempest-VolumesGetTest-467551785 None] Created volume successfully.
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-d8315143-4fc6-44db-a285-a0df54b20268-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "cinder-d8315143-4fc6-44db-a285-a0df54b20268-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-d8315143-4fc6-44db-a285-a0df54b20268" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-d8315143-4fc6-44db-a285-a0df54b20268" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27901a9-aafa-463b-a267-4f685dfcc552]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:42 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268
Sep 25 17:09:42 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:42 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268" returned: 0 in 0.536s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:42 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268
Sep 25 17:09:42 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:43 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d8315143-4fc6-44db-a285-a0df54b20268" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-d8315143-4fc6-44db-a285-a0df54b20268" released by "delete_volume" :: held 0.894s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Created reservations ['734af0e3-5d45-4103-83ef-bab0940cdee4', 'fb872e1c-4755-4a6f-b4d2-3e53da9c0235', 'ff119b01-0c6a-4ab8-bbab-d1d19a01a53a', 'cbfe2054-e0bf-455b-8e31-d41f107dfbee'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:43 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:43 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "cinder-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Acquiring lock "cinder-quobyte-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5e8f93-8f84-4e1d-a2c0-f7e25ac9c5b2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:43 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:09:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-afa8e2da-2d29-45ab-8b0f-8e70142b8500 tempest-VolumesGetTest-467551785 None] Lock "cinder-d8315143-4fc6-44db-a285-a0df54b20268-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:43 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df
Sep 25 17:09:43 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:44 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" returned: 0 in 0.482s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:44 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df
Sep 25 17:09:44 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:44 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" returned: 0 in 0.285s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "cinder-quobyte-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df" released by "delete_volume" :: held 0.844s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Created reservations ['0c154f8f-6c71-410c-8d90-310a69f091dc', '3561aeeb-7d3c-4869-a56f-178bd221a497', '7655d68c-6c54-43d4-a78b-8239fa418c93', '3e9e199d-2398-4013-b06b-3472d7225b3b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:44 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:09:44 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:44 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.297s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:09:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Deleted volume successfully.
Sep 25 17:09:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9c57a7e-537d-4bfe-8e0b-a901c4ec511c tempest-VolumesGetTest-467551785 None] Lock "cinder-ef5d96ee-1fbb-4d97-8707-ae6c9feaf6df-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:09:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:09:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Flow 'volume_create_manager' (12a8ece4-265e-4635-b74b-80105eed5e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39a12a5-3eab-464f-bc46-b661a61903ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39a12a5-3eab-464f-bc46-b661a61903ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1858553761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aeca95-cd8c-4917-8800-032796f11b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c2edf788dd4de4af52fc6124abab2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:54Z,use_quota=True,user_id='3360a1316cf54f4cba0b879875ea8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783d3be2-8e54-4092-af69-a40293ad5208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783d3be2-8e54-4092-af69-a40293ad5208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22140b3-7369-451e-8144-2e55fa0da34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22140b3-7369-451e-8144-2e55fa0da34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50aeca95-cd8c-4917-8800-032796f11b9d', 'volume_name': 'volume-50aeca95-cd8c-4917-8800-032796f11b9d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2727b05-eafa-4ce1-b93d-5162ab4fc98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2727b05-eafa-4ce1-b93d-5162ab4fc98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04247293-bb93-4020-b854-07bb35008380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Volume 50aeca95-cd8c-4917-8800-032796f11b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50aeca95-cd8c-4917-8800-032796f11b9d', 'volume_size': 1}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1858553761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aeca95-cd8c-4917-8800-032796f11b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c2edf788dd4de4af52fc6124abab2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:54Z,use_quota=True,user_id='3360a1316cf54f4cba0b879875ea8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Creating volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:09:54 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:54 devstack sudo[97917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d 1073741824
Sep 25 17:09:54 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:54 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d 1073741824" returned: 0 in 0.715s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:54 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d
Sep 25 17:09:54 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:55 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04247293-bb93-4020-b854-07bb35008380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50aeca95-cd8c-4917-8800-032796f11b9d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e2c53e-2940-4a3f-893b-7368ce8a5659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:09:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Volume volume-50aeca95-cd8c-4917-8800-032796f11b9d (50aeca95-cd8c-4917-8800-032796f11b9d): created successfully
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e2c53e-2940-4a3f-893b-7368ce8a5659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:09:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Flow 'volume_create_manager' (12a8ece4-265e-4635-b74b-80105eed5e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:09:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d6d65f48-cbed-46c2-ba60-2f1d46781df0 tempest-VolumesSnapshotListTestJSON-1953390301 None] Created volume successfully.
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Creating offline snapshot dc6aee38-7e5e-462a-b46f-795330750f02 of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa011425-085d-4349-965b-8df575a8d6d9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:56 devstack sudo[97926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d
Sep 25 17:09:56 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:56 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d" returned: 0 in 0.563s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:57 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 1G
Sep 25 17:09:57 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:57 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 1G" returned: 0 in 0.589s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:57 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:09:57 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:57 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.405s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:57 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 is being set with open permissions: ugo+rw
Sep 25 17:09:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:58 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:09:58 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:58 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:58 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info
Sep 25 17:09:58 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:58 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info" returned: 0 in 0.382s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info is being set with open permissions: ugo+rw
Sep 25 17:09:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:09:58 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info
Sep 25 17:09:58 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:09:59 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.info" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:09:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-59cb3fef-ac80-4e4d-8fa1-9423dbb11fd2 tempest-VolumesSnapshotListTestJSON-1953390301 None] Create snapshot completed successfully
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Creating offline snapshot b1ba4acc-a4fe-4fae-be38-0996349d77fb of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08f27af-ddf5-40a4-8885-2a2c49e43730]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:09:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:00 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:10:00 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:00 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.547s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:00 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb 1G
Sep 25 17:10:00 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:01 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb 1G" returned: 0 in 0.859s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:01 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:01 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:01 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.576s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:01 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb is being set with open permissions: ugo+rw
Sep 25 17:10:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:01 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:01 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:02 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5eafe3c7-070f-4834-89a2-c41953f7e84f tempest-VolumesSnapshotListTestJSON-1953390301 None] Create snapshot completed successfully
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Creating offline snapshot bd60a5d5-84ac-4778-bfd6-4558edf6af7a of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ddf55-6d1a-4d51-880a-040cdabcb2c0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:03 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:03 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:03 devstack sudo[97986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:03 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:04 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.595s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:10:04 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.934s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:04 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a 1G
Sep 25 17:10:04 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:05 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a 1G" returned: 0 in 0.733s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:05 devstack sudo[98018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a
Sep 25 17:10:05 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:05 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a" returned: 0 in 0.610s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:05 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a is being set with open permissions: ugo+rw
Sep 25 17:10:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:05 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a
Sep 25 17:10:05 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:06 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a" returned: 0 in 0.437s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c81cb0f0-405f-4633-8785-93e4e1381a25 tempest-VolumesSnapshotListTestJSON-1953390301 None] Create snapshot completed successfully
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-bd60a5d5-84ac-4778-bfd6-4558edf6af7a-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-bd60a5d5-84ac-4778-bfd6-4558edf6af7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-bd60a5d5-84ac-4778-bfd6-4558edf6af7a" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-bd60a5d5-84ac-4778-bfd6-4558edf6af7a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Deleting offline snapshot bd60a5d5-84ac-4778-bfd6-4558edf6af7a of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] snapshot_file for this snap is: volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e5e2cd-8228-4b76-b3d8-d3ec1961e441]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:09 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a
Sep 25 17:10:09 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:09 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a" returned: 0 in 0.574s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0965d-0db1-42e5-adb2-d43ddc186bf9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:09 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:09 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:10 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:10 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a
Sep 25 17:10:10 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:10 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a" returned: 0 in 0.732s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:10 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a
Sep 25 17:10:10 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:11 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.bd60a5d5-84ac-4778-bfd6-4558edf6af7a" returned: 0 in 0.408s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-bd60a5d5-84ac-4778-bfd6-4558edf6af7a" released by "_delete_snapshot" :: held 2.319s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" released by "delete_snapshot" :: held 2.367s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Created reservations ['ebec79ce-6374-4ecb-8316-17e2210e70fe', '56fde254-e6e3-4a21-bcae-76f4817ee4d7', '355ce7c9-581c-4d5d-b8f6-db124f41793c', 'adc1da76-f9ed-4b16-9508-918b36f08199'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Delete snapshot completed successfully.
Sep 25 17:10:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92c8f7a4-fe64-4ef2-9e34-df64fe4a906d tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-bd60a5d5-84ac-4778-bfd6-4558edf6af7a-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-b1ba4acc-a4fe-4fae-be38-0996349d77fb-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-b1ba4acc-a4fe-4fae-be38-0996349d77fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-b1ba4acc-a4fe-4fae-be38-0996349d77fb" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-b1ba4acc-a4fe-4fae-be38-0996349d77fb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Deleting offline snapshot b1ba4acc-a4fe-4fae-be38-0996349d77fb of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] snapshot_file for this snap is: volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d55ab-aa46-4c5d-a727-bc3612d675ce]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:12 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:12 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:13 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 1.145s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ecfa6-2871-45c5-aad1-da283b1b67db]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:14 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:10:14 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:14 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=80,cinder:SELECT=63,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:10:14 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=81,cinder:SELECT=65,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:10:14 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.838s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:14 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:14 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:15 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.830s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:15 devstack sudo[98256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb
Sep 25 17:10:15 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:16 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.b1ba4acc-a4fe-4fae-be38-0996349d77fb" returned: 0 in 0.933s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-b1ba4acc-a4fe-4fae-be38-0996349d77fb" released by "_delete_snapshot" :: held 4.172s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" released by "delete_snapshot" :: held 4.231s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Created reservations ['ef5b28c4-ceb0-43f4-a171-9380f633b262', 'f02550a6-d6d8-4be6-9118-6029a93542c8', '4d7c7a99-b324-40ce-b21e-e1431d74f4fd', 'f457f504-b943-4082-9bc7-1502d58bb7e0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Delete snapshot completed successfully.
Sep 25 17:10:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dd949c77-f05d-4dd6-b8a9-6b3d4df91964 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-b1ba4acc-a4fe-4fae-be38-0996349d77fb-delete_snapshot" released by "delete_snapshot" :: held 4.861s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-dc6aee38-7e5e-462a-b46f-795330750f02-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-dc6aee38-7e5e-462a-b46f-795330750f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-dc6aee38-7e5e-462a-b46f-795330750f02" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-dc6aee38-7e5e-462a-b46f-795330750f02" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Deleting offline snapshot dc6aee38-7e5e-462a-b46f-795330750f02 of volume 50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] snapshot_file for this snap is: volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ca61e-28c3-4bb2-948b-9478290ed4ae]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:18 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:10:18 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:18 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.641s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50aeca95-cd8c-4917-8800-032796f11b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19cadf-f9a5-421a-abb9-231a6a149f82]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:19 devstack sudo[98290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d
Sep 25 17:10:19 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (b3be3467-20c9-4485-98d9-1b248b9e4428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf73546-edb6-4ac3-9cc5-f81ff2fa2b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf73546-edb6-4ac3-9cc5-f81ff2fa2b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950486789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbc310e-eb8a-452e-b454-31f78669d1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:19Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ef714-0cc6-4c64-aac0-af1f3f1e00e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ef714-0cc6-4c64-aac0-af1f3f1e00e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fea7335-dce5-485d-87de-1d04bd03db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fea7335-dce5-485d-87de-1d04bd03db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbc310e-eb8a-452e-b454-31f78669d1cf', 'volume_name': 'volume-dbbc310e-eb8a-452e-b454-31f78669d1cf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0fa61-cae3-4c76-a471-40a16739e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0fa61-cae3-4c76-a471-40a16739e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a45e94-27b1-469a-8e13-563d74dc2f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Volume dbbc310e-eb8a-452e-b454-31f78669d1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbc310e-eb8a-452e-b454-31f78669d1cf', 'volume_size': 1}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-950486789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbc310e-eb8a-452e-b454-31f78669d1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:19Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Creating volume dbbc310e-eb8a-452e-b454-31f78669d1cf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:19 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:19 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf 1073741824
Sep 25 17:10:19 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:19 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d" returned: 0 in 0.620s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:19 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:10:19 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:20 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf 1073741824" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:20 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.618s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:20 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02
Sep 25 17:10:20 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:20 devstack sudo[98311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf
Sep 25 17:10:20 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:20 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d.dc6aee38-7e5e-462a-b46f-795330750f02" returned: 0 in 0.459s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:20 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf" returned: 0 in 0.502s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-dc6aee38-7e5e-462a-b46f-795330750f02" released by "_delete_snapshot" :: held 2.604s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a45e94-27b1-469a-8e13-563d74dc2f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbc310e-eb8a-452e-b454-31f78669d1cf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c88f9a-bcd1-4f2a-b892-3be753991117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" released by "delete_snapshot" :: held 2.708s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Volume volume-dbbc310e-eb8a-452e-b454-31f78669d1cf (dbbc310e-eb8a-452e-b454-31f78669d1cf): created successfully
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c88f9a-bcd1-4f2a-b892-3be753991117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (b3be3467-20c9-4485-98d9-1b248b9e4428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1115e452-3206-4fcb-a99b-088da12b7f5f tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Created reservations ['2191941e-6fa4-4767-a11c-281cf2abed1c', 'ef9f2ecf-bacc-4ad1-b498-81975b1cd2a2', 'ae044e37-35ae-4d47-a198-ad43ecca4314', 'e619785c-d1f1-4efb-aa0a-492a9ee590e9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Delete snapshot completed successfully.
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4b75d14f-68d0-4f93-91ab-96fbaafcf47f tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-dc6aee38-7e5e-462a-b46f-795330750f02-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-692fd427-0566-47c6-92fc-a477279c7999 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-692fd427-0566-47c6-92fc-a477279c7999 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf" acquired by "attach_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-692fd427-0566-47c6-92fc-a477279c7999 tempest-VolumesActionsTest-1063304577 None] Attaching volume dbbc310e-eb8a-452e-b454-31f78669d1cf to instance 2f788a3c-8df9-4b13-b1d2-0ffe9afe19cb at mountpoint /dev/vdb on host None.
Sep 25 17:10:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-692fd427-0566-47c6-92fc-a477279c7999 tempest-VolumesActionsTest-1063304577 None] Attach volume completed successfully.
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-692fd427-0566-47c6-92fc-a477279c7999 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf" released by "attach_volume" :: held 0.186s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-50aeca95-cd8c-4917-8800-032796f11b9d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-50aeca95-cd8c-4917-8800-032796f11b9d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[127abf38-b563-40a2-bfbf-c93acb999bdf]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-822cb070-45b6-475e-be08-b8407bfc5e7d req-d5dd3c1c-31f7-4975-96b5-3c853404fd80 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-822cb070-45b6-475e-be08-b8407bfc5e7d req-d5dd3c1c-31f7-4975-96b5-3c853404fd80 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-822cb070-45b6-475e-be08-b8407bfc5e7d req-d5dd3c1c-31f7-4975-96b5-3c853404fd80 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:21 devstack sudo[98327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d
Sep 25 17:10:21 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-822cb070-45b6-475e-be08-b8407bfc5e7d req-d5dd3c1c-31f7-4975-96b5-3c853404fd80 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-f76ef61e-4809-432a-b286-7271895d01a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dba44f81-51a1-403a-b071-477a36c18cff', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:10:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-822cb070-45b6-475e-be08-b8407bfc5e7d req-d5dd3c1c-31f7-4975-96b5-3c853404fd80 tempest-TestServerVolumeAttachmentScenario-1526305542 None] attachment_update completed successfully.
Sep 25 17:10:22 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d" returned: 0 in 0.629s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:22 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d
Sep 25 17:10:22 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Terminate volume connection completed successfully.
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Detaching volume dbbc310e-eb8a-452e-b454-31f78669d1cf from instance 2f788a3c-8df9-4b13-b1d2-0ffe9afe19cb.
Sep 25 17:10:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Detach volume completed successfully.
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a23026e-6a58-4382-bb1d-0917d8b6af0f tempest-VolumesActionsTest-287654625 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:22 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-50aeca95-cd8c-4917-8800-032796f11b9d" returned: 0 in 0.527s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-quobyte-50aeca95-cd8c-4917-8800-032796f11b9d" released by "delete_volume" :: held 1.311s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7b97ea6-94b0-4dd3-a202-f8d351eb601c tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Created reservations ['dedb1198-5902-4648-b99b-4c01b95b0daa', 'c891999b-eedf-4d3a-877b-7b92ade8c205', 'f628eb06-4e0a-4f81-b58d-7d6e605c49c0', '4314488e-38da-4361-8840-7b80979d7a96'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7b97ea6-94b0-4dd3-a202-f8d351eb601c tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d7b97ea6-94b0-4dd3-a202-f8d351eb601c tempest-VolumesActionsTest-1063304577 None] Volume detach called, but volume not attached.
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7b97ea6-94b0-4dd3-a202-f8d351eb601c tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:23 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:23 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:23 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.437s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Deleted volume successfully.
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0ac00f7-a842-4f90-990e-de306cc9f506 tempest-VolumesSnapshotListTestJSON-1953390301 None] Lock "cinder-50aeca95-cd8c-4917-8800-032796f11b9d-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-quobyte-dbbc310e-eb8a-452e-b454-31f78669d1cf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-quobyte-dbbc310e-eb8a-452e-b454-31f78669d1cf" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e084f4d-34d5-4091-b457-6081d480d70d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:24 devstack sudo[98754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf
Sep 25 17:10:24 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:24 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf" returned: 0 in 0.588s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:24 devstack sudo[98765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf
Sep 25 17:10:24 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:25 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbbc310e-eb8a-452e-b454-31f78669d1cf" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-quobyte-dbbc310e-eb8a-452e-b454-31f78669d1cf" released by "delete_volume" :: held 1.127s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Created reservations ['af16e79a-a690-4f1f-b37f-29074eaf607d', 'fd9b4bda-69f8-4694-8f0d-17672a5ddaab', '1d0c6e40-fb32-4123-b999-adc68ff3d68b', 'd922af23-b2cf-4cf3-9cd3-23ea7fd2b095'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:25 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:25 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:25 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.411s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Deleted volume successfully.
Sep 25 17:10:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f50ff38-5f3b-4560-8b81-1c13c572c9e7 tempest-VolumesActionsTest-1063304577 None] Lock "cinder-dbbc310e-eb8a-452e-b454-31f78669d1cf-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (88f0b694-9c26-44e1-9e33-dd46ec9e373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381b1b2f-25f1-415b-b2a8-cec3ba3e8b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381b1b2f-25f1-415b-b2a8-cec3ba3e8b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796542037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe4963-8c74-4035-ba6d-525baef4a7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:30Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13719a13-0d2f-4892-a38d-12e1656575b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13719a13-0d2f-4892-a38d-12e1656575b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43ae3c-b76d-4ba7-a7ca-ad9e0fb1fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b43ae3c-b76d-4ba7-a7ca-ad9e0fb1fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fe4963-8c74-4035-ba6d-525baef4a7d7', 'volume_name': 'volume-70fe4963-8c74-4035-ba6d-525baef4a7d7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6542ab-8fb7-4c43-a86b-fb700c5ed140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6542ab-8fb7-4c43-a86b-fb700c5ed140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52c134-6ab2-4867-9551-a5104c04982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Volume 70fe4963-8c74-4035-ba6d-525baef4a7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fe4963-8c74-4035-ba6d-525baef4a7d7', 'volume_size': 1}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1796542037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe4963-8c74-4035-ba6d-525baef4a7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:30Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Creating volume 70fe4963-8c74-4035-ba6d-525baef4a7d7 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:30 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 1073741824
Sep 25 17:10:30 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-37e014b7-1c2f-44dd-8122-01800ab502d4 req-9843d47b-7f60-4634-ad92-c9ca7a783f1e tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Flow 'volume_create_manager' (a35d3c45-9f67-4aac-99e1-293776565c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95758ad7-8741-461b-ad50-bb7668f5b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95758ad7-8741-461b-ad50-bb7668f5b076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-481840086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c157dffd-c084-46b3-99db-a5df4419c633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ce03c2af5541c69ecdaf68b202fab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:30Z,use_quota=True,user_id='2679965adf1f4603b7012c11f9ada77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688bcc55-dc0a-4b1f-8793-f7f03dbff793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688bcc55-dc0a-4b1f-8793-f7f03dbff793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b4d3b-2467-43a6-a755-4068bc40b447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b4d3b-2467-43a6-a755-4068bc40b447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c157dffd-c084-46b3-99db-a5df4419c633', 'volume_name': 'volume-c157dffd-c084-46b3-99db-a5df4419c633', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fcca81-6305-445e-9397-22245aabd0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fcca81-6305-445e-9397-22245aabd0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c73a17-c34f-46fb-b606-287fbc2fa9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Volume c157dffd-c084-46b3-99db-a5df4419c633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c157dffd-c084-46b3-99db-a5df4419c633', 'volume_size': 2}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:30 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 1073741824" returned: 0 in 0.534s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:30 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7
Sep 25 17:10:30 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:30 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7" returned: 0 in 0.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-37e014b7-1c2f-44dd-8122-01800ab502d4 req-9843d47b-7f60-4634-ad92-c9ca7a783f1e tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.745s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52c134-6ab2-4867-9551-a5104c04982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fe4963-8c74-4035-ba6d-525baef4a7d7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a2fc8a-8154-4d9f-b0f1-d09bc443dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-37e014b7-1c2f-44dd-8122-01800ab502d4 req-9843d47b-7f60-4634-ad92-c9ca7a783f1e tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-481840086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c157dffd-c084-46b3-99db-a5df4419c633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ce03c2af5541c69ecdaf68b202fab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:30Z,use_quota=True,user_id='2679965adf1f4603b7012c11f9ada77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Creating volume c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 2147483648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:31 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 2147483648
Sep 25 17:10:31 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Volume volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 (70fe4963-8c74-4035-ba6d-525baef4a7d7): created successfully
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a2fc8a-8154-4d9f-b0f1-d09bc443dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (88f0b694-9c26-44e1-9e33-dd46ec9e373b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-37e014b7-1c2f-44dd-8122-01800ab502d4 req-9843d47b-7f60-4634-ad92-c9ca7a783f1e tempest-TestServerVolumeAttachmentScenario-1526305542 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-3b46f57b-0228-4002-9597-6ea3eef7751f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b72332cc-13f1-4899-af99-972e143ba8cf', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0f8a8bbe-c216-4e68-bacf-2eca305c3a67 tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-37e014b7-1c2f-44dd-8122-01800ab502d4 req-9843d47b-7f60-4634-ad92-c9ca7a783f1e tempest-TestServerVolumeAttachmentScenario-1526305542 None] attachment_update completed successfully.
Sep 25 17:10:31 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 2147483648" returned: 0 in 0.520s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:31 devstack sudo[98881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633
Sep 25 17:10:31 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:31 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633" returned: 0 in 0.290s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c73a17-c34f-46fb-b606-287fbc2fa9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c157dffd-c084-46b3-99db-a5df4419c633', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac10869-b52d-46f7-92bb-d246c2d2ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Volume volume-c157dffd-c084-46b3-99db-a5df4419c633 (c157dffd-c084-46b3-99db-a5df4419c633): created successfully
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac10869-b52d-46f7-92bb-d246c2d2ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Flow 'volume_create_manager' (a35d3c45-9f67-4aac-99e1-293776565c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f12c5918-d7f2-41a5-bc7d-269d9f1191d8 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Created volume successfully.
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-70fe4963-8c74-4035-ba6d-525baef4a7d7-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "cinder-70fe4963-8c74-4035-ba6d-525baef4a7d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-quobyte-70fe4963-8c74-4035-ba6d-525baef4a7d7" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-70fe4963-8c74-4035-ba6d-525baef4a7d7" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093c882-efc9-47de-9e1d-5e1cd05f90a7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:32 devstack sudo[98884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7
Sep 25 17:10:32 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:32 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7" returned: 0 in 0.468s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:32 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7
Sep 25 17:10:32 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Creating offline snapshot a37fa8dd-550d-420d-a05c-bc531fbb2f57 of volume c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[89582259-5cd7-4a3d-ab2c-d1e22eea66ed]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:32 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633
Sep 25 17:10:32 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:33 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8fb6916d-0a8b-489b-9790-4d583a8c6a59 req-0245b1e5-b0c4-4f71-87c3-ce3ed2982777 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Terminate volume connection completed successfully.
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8fb6916d-0a8b-489b-9790-4d583a8c6a59 req-0245b1e5-b0c4-4f71-87c3-ce3ed2982777 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Deleting attachment b72332cc-13f1-4899-af99-972e143ba8cf. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-70fe4963-8c74-4035-ba6d-525baef4a7d7" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-70fe4963-8c74-4035-ba6d-525baef4a7d7" released by "delete_volume" :: held 0.904s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:33 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633" returned: 0 in 0.457s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:33 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 2G
Sep 25 17:10:33 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Created reservations ['8bff425a-6bd7-4ab4-b40f-88fadfdb73ac', '03c18482-c959-415f-8859-d6f777b0c71b', 'b6b5ac16-8cff-48c7-a01d-bdc13aed30dc', '82796033-89a7-436c-a384-a8a36dd656cc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:33 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 2G" returned: 0 in 0.462s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c157dffd-c084-46b3-99db-a5df4419c633 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:33 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c157dffd-c084-46b3-99db-a5df4419c633 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57
Sep 25 17:10:33 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:33 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:33 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:34 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:34 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c157dffd-c084-46b3-99db-a5df4419c633 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57" returned: 0 in 0.336s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:34 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 is being set with open permissions: ugo+rw
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Deleted volume successfully.
Sep 25 17:10:34 devstack sudo[98921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57
Sep 25 17:10:34 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6293be2e-7513-4ecc-af28-ad8695dff04e tempest-VolumesActionsTest-287654625 None] Lock "cinder-70fe4963-8c74-4035-ba6d-525baef4a7d7-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:34 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:34 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info
Sep 25 17:10:34 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:34 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info" returned: 0 in 0.300s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:34 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info is being set with open permissions: ugo+rw
Sep 25 17:10:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:34 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info
Sep 25 17:10:34 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:35 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (88536e10-1b79-4798-bfe3-c1c6b135553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec18f35-43c9-4ebb-99da-a119098891b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.info" returned: 0 in 0.389s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec18f35-43c9-4ebb-99da-a119098891b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434874353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b2ddb-1cba-4118-b4ba-63920b26b03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:35Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62673581-93a9-4e18-8d2c-ad2c792dfae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62673581-93a9-4e18-8d2c-ad2c792dfae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f800f5-476b-42e9-8815-e768668c71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f800f5-476b-42e9-8815-e768668c71ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004b2ddb-1cba-4118-b4ba-63920b26b03d', 'volume_name': 'volume-004b2ddb-1cba-4118-b4ba-63920b26b03d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b29860-a84f-49f4-9563-3c7368806300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b29860-a84f-49f4-9563-3c7368806300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9abb0c1-a759-4580-8cd3-61feb0ebf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Volume 004b2ddb-1cba-4118-b4ba-63920b26b03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004b2ddb-1cba-4118-b4ba-63920b26b03d', 'volume_size': 1}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434874353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b2ddb-1cba-4118-b4ba-63920b26b03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:35Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Creating volume 004b2ddb-1cba-4118-b4ba-63920b26b03d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:35 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:35 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d 1073741824
Sep 25 17:10:35 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b1b031c8-841d-49f2-a7de-b196bfea242d tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Create snapshot completed successfully
Sep 25 17:10:35 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d 1073741824" returned: 0 in 0.550s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8bf7954f-6a8f-4bcb-9f6e-7712ecb588d3 req-5a464624-0910-4b75-b442-a4bad44d2bb3 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Terminate volume connection completed successfully.
Sep 25 17:10:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8bf7954f-6a8f-4bcb-9f6e-7712ecb588d3 req-5a464624-0910-4b75-b442-a4bad44d2bb3 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Deleting attachment dba44f81-51a1-403a-b071-477a36c18cff. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:10:35 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d
Sep 25 17:10:35 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:36 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9abb0c1-a759-4580-8cd3-61feb0ebf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004b2ddb-1cba-4118-b4ba-63920b26b03d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651f6bc-03fe-4a3c-a01c-16bf6c7e5e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Volume volume-004b2ddb-1cba-4118-b4ba-63920b26b03d (004b2ddb-1cba-4118-b4ba-63920b26b03d): created successfully
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a651f6bc-03fe-4a3c-a01c-16bf6c7e5e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (88536e10-1b79-4798-bfe3-c1c6b135553d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "cinder-a37fa8dd-550d-420d-a05c-bc531fbb2f57-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12434cbc-f284-4f57-b676-881eb2879ffc tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-a37fa8dd-550d-420d-a05c-bc531fbb2f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "cinder-quobyte-a37fa8dd-550d-420d-a05c-bc531fbb2f57" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-a37fa8dd-550d-420d-a05c-bc531fbb2f57" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Deleting offline snapshot a37fa8dd-550d-420d-a05c-bc531fbb2f57 of volume c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] snapshot_file for this snap is: volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558a093-0480-4fec-9db8-1b7a636e1741]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:36 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57
Sep 25 17:10:36 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (b7b2c3e3-a539-484f-b386-be581aa4c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3c2519-e510-457a-8c13-f54f44bd3336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3c2519-e510-457a-8c13-f54f44bd3336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1858514114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:37Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0859dbc-6ca2-4d17-983e-88cf4b47baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0859dbc-6ca2-4d17-983e-88cf4b47baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726dc63-8f5b-4f34-8a8f-99105254b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f726dc63-8f5b-4f34-8a8f-99105254b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0', 'volume_name': 'volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3793aa5-1c25-4453-b3c1-8923706d079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3793aa5-1c25-4453-b3c1-8923706d079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca59d1e-7262-492c-8fc6-0fa0db3e0f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Volume e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0', 'volume_size': 1}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1858514114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:37Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Creating volume e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:36 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:36 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 1073741824
Sep 25 17:10:36 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:36 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57" returned: 0 in 0.510s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c157dffd-c084-46b3-99db-a5df4419c633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2027a23-fadc-4648-aaee-b7734fe8acc6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:37 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633
Sep 25 17:10:37 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:37 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 1073741824" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:37 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633" returned: 0 in 0.494s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:37 devstack sudo[99001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57
Sep 25 17:10:37 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-004b2ddb-1cba-4118-b4ba-63920b26b03d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "cinder-004b2ddb-1cba-4118-b4ba-63920b26b03d-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:37 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0
Sep 25 17:10:37 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-quobyte-004b2ddb-1cba-4118-b4ba-63920b26b03d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-004b2ddb-1cba-4118-b4ba-63920b26b03d" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c116039-56f2-4b61-be5c-964bdf431b88]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:37 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57" returned: 0 in 0.595s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:38 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d
Sep 25 17:10:38 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:38 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57
Sep 25 17:10:38 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:38 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" returned: 0 in 0.487s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca59d1e-7262-492c-8fc6-0fa0db3e0f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97a2d9-121e-4c3f-b415-3f94f3cb0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Volume volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 (e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0): created successfully
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97a2d9-121e-4c3f-b415-3f94f3cb0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (b7b2c3e3-a539-484f-b386-be581aa4c150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-effb5a90-6370-49da-928d-0d38d29aedbc tempest-AttachVolumeNegativeTest-1419689403 None] Created volume successfully.
Sep 25 17:10:38 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d" returned: 0 in 0.557s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:38 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633.a37fa8dd-550d-420d-a05c-bc531fbb2f57" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:38 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d
Sep 25 17:10:38 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-a37fa8dd-550d-420d-a05c-bc531fbb2f57" released by "_delete_snapshot" :: held 2.213s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" released by "delete_snapshot" :: held 2.250s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Created reservations ['b5b6cb5c-9146-48e8-a4f6-18e17100fa71', '048f01b7-5828-406c-9bb0-0fe5f2b3d5c7', '9d88fbb9-967f-42f6-9bd9-edd1d34e42b1', 'c95ea124-19d9-4244-8e08-bbbb6f6ed4df'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Delete snapshot completed successfully.
Sep 25 17:10:38 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6eee3069-587c-41fd-9fc0-d84c8e6a81a9 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-a37fa8dd-550d-420d-a05c-bc531fbb2f57-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-004b2ddb-1cba-4118-b4ba-63920b26b03d" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-004b2ddb-1cba-4118-b4ba-63920b26b03d" released by "delete_volume" :: held 1.058s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Created reservations ['536bc125-5442-44c5-970d-231cad1bd8ef', '353efd27-8b95-4845-ae6a-2efaed32cbee', '98ac42a9-9c1a-41bd-9e58-b08c24a8de4e', '3409d110-b8fd-4104-bd07-9d4ae83c47ea'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:38 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:38 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:39 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.330s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Deleted volume successfully.
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c1308e9-a0d9-4343-9444-bbe4ea495ade tempest-VolumesActionsTest-287654625 None] Lock "cinder-004b2ddb-1cba-4118-b4ba-63920b26b03d-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "cinder-c157dffd-c084-46b3-99db-a5df4419c633-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-c157dffd-c084-46b3-99db-a5df4419c633-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2195b71-f657-4c65-a839-d6084dd1bf54]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:39 devstack sudo[99049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633
Sep 25 17:10:39 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4ef59da2-f6cf-43b9-8903-d516e810bb61 req-710137ab-75ec-478a-80e0-93a73f83bae5 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4ef59da2-f6cf-43b9-8903-d516e810bb61 req-710137ab-75ec-478a-80e0-93a73f83bae5 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4ef59da2-f6cf-43b9-8903-d516e810bb61 req-710137ab-75ec-478a-80e0-93a73f83bae5 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-4ef59da2-f6cf-43b9-8903-d516e810bb61 req-710137ab-75ec-478a-80e0-93a73f83bae5 tempest-AttachVolumeNegativeTest-1419689403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bf26e13-ffa5-4855-acfc-628b078f20b5', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:10:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-4ef59da2-f6cf-43b9-8903-d516e810bb61 req-710137ab-75ec-478a-80e0-93a73f83bae5 tempest-AttachVolumeNegativeTest-1419689403 None] attachment_update completed successfully.
Sep 25 17:10:40 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633" returned: 0 in 0.567s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:40 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633
Sep 25 17:10:40 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:40 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (98d6a511-a8db-479b-849a-4daba17fb761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f4863-5051-493a-a461-917451f46167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c157dffd-c084-46b3-99db-a5df4419c633" returned: 0 in 0.454s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-quobyte-c157dffd-c084-46b3-99db-a5df4419c633" released by "delete_volume" :: held 1.122s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f4863-5051-493a-a461-917451f46167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1834265364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:41Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81025dc4-2cda-4de0-9825-f603f955df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81025dc4-2cda-4de0-9825-f603f955df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bab4356-fbb9-4551-afbf-318cc4f16887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bab4356-fbb9-4551-afbf-318cc4f16887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3', 'volume_name': 'volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362d14dd-e77a-4297-84e6-d40eb82be94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362d14dd-e77a-4297-84e6-d40eb82be94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfee4a8b-e2ea-438a-9de3-24d6d6ae7674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Volume 94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3', 'volume_size': 1}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1834265364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:41Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Creating volume 94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:40 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:40 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 1073741824
Sep 25 17:10:40 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Created reservations ['582b3309-ceb0-4e90-9191-fbbc7014c976', '81cce0fe-1e94-4697-9e5c-3b8c416459a3', '9c1c0a04-40a7-4fcb-a47c-3e2af59b0f6b', '172ab4e5-ed0b-4d36-8cb9-54c0e4c46e32'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:41 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:41 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:41 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Deleted volume successfully.
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-042e0ddb-8cd4-4dc0-9bd4-781dc4188ff7 tempest-VolumesSnapshotNegativeTestJSON-805497083 None] Lock "cinder-c157dffd-c084-46b3-99db-a5df4419c633-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:41 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 1073741824" returned: 0 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:41 devstack sudo[99481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3
Sep 25 17:10:41 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:42 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" returned: 0 in 0.442s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfee4a8b-e2ea-438a-9de3-24d6d6ae7674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621959fa-74ed-4eda-b660-4c13d4fa630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Volume volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 (94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3): created successfully
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621959fa-74ed-4eda-b660-4c13d4fa630e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (98d6a511-a8db-479b-849a-4daba17fb761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ecec5731-01f5-4bec-a08b-16d449b77332 tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "cinder-3b46f57b-0228-4002-9597-6ea3eef7751f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-3b46f57b-0228-4002-9597-6ea3eef7751f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "cinder-quobyte-3b46f57b-0228-4002-9597-6ea3eef7751f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-quobyte-3b46f57b-0228-4002-9597-6ea3eef7751f" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b874ffb7-8754-4f8e-b7cd-50bdd2c795fe]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:42 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f
Sep 25 17:10:42 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:43 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f" returned: 0 in 0.525s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:43 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f
Sep 25 17:10:43 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "cinder-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-quobyte-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef886201-b74b-4fc8-89e7-edd32791f86c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:43 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3
Sep 25 17:10:43 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:43 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3b46f57b-0228-4002-9597-6ea3eef7751f" returned: 0 in 0.423s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-quobyte-3b46f57b-0228-4002-9597-6ea3eef7751f" released by "delete_volume" :: held 1.015s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Created reservations ['e4b2ae42-1c8c-49e8-a7e8-e2bb6f92a30c', '0bae022f-32cd-4e8d-b681-bc2fa8a71775', '5c1a2a96-d9b8-49fa-9e56-3d52787b7f56', '51bc36e6-bcc4-4a9b-9ae9-bd5ca9445e04'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:43 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:43 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:43 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" returned: 0 in 0.548s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:43 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3
Sep 25 17:10:43 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:44 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.378s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Deleted volume successfully.
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bada82d9-2f32-42ca-9a3d-cf58e9045fee tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-3b46f57b-0228-4002-9597-6ea3eef7751f-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:44 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" returned: 0 in 0.337s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3" released by "delete_volume" :: held 0.968s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Created reservations ['69352074-ab9b-4002-86ca-5cc4187fc6f5', '2a48cc12-8cef-400a-9da8-5f74b953c0f6', 'ad472c33-4cdf-4be3-8e5c-8efc17d025ac', 'e2aa0284-a50e-4161-a5e3-a5e9050d24fd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:44 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:44 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:44 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Deleted volume successfully.
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-630052b8-6d11-40a1-85b3-36fb111fcb71 tempest-VolumesActionsTest-287654625 None] Lock "cinder-94de0eef-1d2f-42d0-bd8c-4ffc3ed3a2c3-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "cinder-f76ef61e-4809-432a-b286-7271895d01a1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-f76ef61e-4809-432a-b286-7271895d01a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "cinder-quobyte-f76ef61e-4809-432a-b286-7271895d01a1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-quobyte-f76ef61e-4809-432a-b286-7271895d01a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9031667-e10c-4dad-8de9-cdfe27adca37]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:45 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1
Sep 25 17:10:45 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:45 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1" returned: 0 in 0.418s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:45 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1
Sep 25 17:10:45 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:45 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-f76ef61e-4809-432a-b286-7271895d01a1" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-quobyte-f76ef61e-4809-432a-b286-7271895d01a1" released by "delete_volume" :: held 0.757s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Created reservations ['db53b129-d539-4a54-b716-e95271b04c6a', '7a8f4204-4c19-41bf-908a-454fd70b2ad1', '3eb538ef-869a-4add-8e14-1b52db8fdd06', 'e32d01f6-cf83-410b-a100-792c038671aa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:45 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:45 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (a399855d-80e2-4394-8093-66c1efb65cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94107957-9e5e-4e2c-b834-4b9835da372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94107957-9e5e-4e2c-b834-4b9835da372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887101038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fc8b5f-ced0-42e6-a6e9-a194d91be046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:46Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e978bd-45f9-411c-9401-557250521a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e978bd-45f9-411c-9401-557250521a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90dd4f2-da54-4f63-80cf-62f5078c33e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90dd4f2-da54-4f63-80cf-62f5078c33e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fc8b5f-ced0-42e6-a6e9-a194d91be046', 'volume_name': 'volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031d8f1c-d2cc-4340-9bf1-fdea4365f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031d8f1c-d2cc-4340-9bf1-fdea4365f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5c4733-5b0c-4a02-8666-83efb5b1508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Volume 26fc8b5f-ced0-42e6-a6e9-a194d91be046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046', 'volume_size': 1}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887101038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fc8b5f-ced0-42e6-a6e9-a194d91be046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:46Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Creating volume 26fc8b5f-ced0-42e6-a6e9-a194d91be046 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:46 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 1073741824
Sep 25 17:10:46 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:46 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Deleted volume successfully.
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16e62a2f-5df2-4e4d-97c6-8bb3f35126c8 tempest-TestServerVolumeAttachmentScenario-1526305542 None] Lock "cinder-f76ef61e-4809-432a-b286-7271895d01a1-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:46 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 1073741824" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:46 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046
Sep 25 17:10:46 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:47 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5c4733-5b0c-4a02-8666-83efb5b1508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f37017-4e8e-49f2-a3e0-fe857dcda462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Volume volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 (26fc8b5f-ced0-42e6-a6e9-a194d91be046): created successfully
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f37017-4e8e-49f2-a3e0-fe857dcda462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (a399855d-80e2-4394-8093-66c1efb65cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dbbf518d-ab40-4bf2-8003-a4cf24bda813 tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-26fc8b5f-ced0-42e6-a6e9-a194d91be046-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "cinder-26fc8b5f-ced0-42e6-a6e9-a194d91be046-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Acquiring lock "cinder-quobyte-26fc8b5f-ced0-42e6-a6e9-a194d91be046" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-26fc8b5f-ced0-42e6-a6e9-a194d91be046" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa3aaf-159f-45b7-a887-4f59ccd44fa1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:48 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046
Sep 25 17:10:48 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:49 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046" returned: 0 in 0.418s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:49 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046
Sep 25 17:10:49 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:49 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26fc8b5f-ced0-42e6-a6e9-a194d91be046" returned: 0 in 0.319s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "cinder-quobyte-26fc8b5f-ced0-42e6-a6e9-a194d91be046" released by "delete_volume" :: held 0.805s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Created reservations ['af77598b-1ae6-47b5-b024-397450115a6d', '032b9709-6015-4668-8b73-989e9dad6e34', '59ad7429-6c1f-4a14-b394-d427b974d723', 'ae563b94-354b-4faa-8543-975244c85275'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:49 devstack sudo[99556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:49 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:49 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.354s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Deleted volume successfully.
Sep 25 17:10:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c4998e96-55c9-4c3d-99c0-9b0ab5b86e74 tempest-VolumesActionsTest-287654625 None] Lock "cinder-26fc8b5f-ced0-42e6-a6e9-a194d91be046-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (ae626ff8-0a8f-4c06-8108-b1a2d539eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e782683d-a58c-44c8-9676-52e0421879a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e782683d-a58c-44c8-9676-52e0421879a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604246886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:50Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1988be5-b290-48ed-9a12-b8b2087c9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1988be5-b290-48ed-9a12-b8b2087c9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295dbc26-2311-4c37-8456-f7890bb860d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295dbc26-2311-4c37-8456-f7890bb860d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3', 'volume_name': 'volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94c08f2-4ae6-4234-ad86-b6eeda60658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94c08f2-4ae6-4234-ad86-b6eeda60658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692fdf1e-126c-483e-9ed6-2ed9cef2697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Volume bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3', 'volume_size': 1}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604246886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417c017da294601894cf9e4662c461f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:50Z,use_quota=True,user_id='6bffdcd7cb324afd96ab28ecd280ffb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Creating volume bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:10:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:10:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:50 devstack sudo[99559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 1073741824
Sep 25 17:10:50 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:51 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 1073741824" returned: 0 in 0.564s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:51 devstack sudo[99565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3
Sep 25 17:10:51 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:51 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692fdf1e-126c-483e-9ed6-2ed9cef2697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cd58c-d470-4074-9c97-8926fa12ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:10:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Volume volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 (bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3): created successfully
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91cd58c-d470-4074-9c97-8926fa12ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:10:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Flow 'volume_create_manager' (ae626ff8-0a8f-4c06-8108-b1a2d539eb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:10:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-11b187c9-6849-4a55-8c07-35cf04c6b2e4 tempest-VolumesActionsTest-1063304577 None] Created volume successfully.
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "cinder-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Acquiring lock "cinder-quobyte-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "cinder-quobyte-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c51c57-1d93-4aaa-b4ef-ec4370d15d93]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:53 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3
Sep 25 17:10:53 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:53 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:53 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3
Sep 25 17:10:53 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:54 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" returned: 0 in 0.324s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "cinder-quobyte-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3" released by "delete_volume" :: held 0.881s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Created reservations ['a8033f6a-da68-42ff-89d9-86533086c329', '15100510-3d9c-4969-b432-641710c0c3fb', '2354da37-8b41-47ed-8c83-d55e6d7d4d13', '38194807-2ef1-47f7-b04c-30bde5ebbf78'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:10:54 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:10:54 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:10:54 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:10:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Deleted volume successfully.
Sep 25 17:10:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-73d21b7f-ce19-450d-92ab-55dea10b82fe tempest-VolumesActionsTest-1063304577 None] Lock "cinder-bcdd2bd2-c3d6-494f-93d4-ec0281b15cb3-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:03 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:11:03 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:03 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.329s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:11:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:11:04 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=112,cinder:INSERT=28,cinder:UPDATE=140,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:11:04 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=116,cinder:INSERT=35,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (a4539ff5-99b6-44c9-9c96-b8dbfebd1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92b6ee-da61-4d08-ad0b-19dfe54e2c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92b6ee-da61-4d08-ad0b-19dfe54e2c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148558959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7ee0a-8f21-4dc6-9664-f21f46f5350e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:28Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43617f6c-23aa-4d60-b914-c8d33e9fac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43617f6c-23aa-4d60-b914-c8d33e9fac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59602ec8-1508-45a6-bc38-e7df6be04821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59602ec8-1508-45a6-bc38-e7df6be04821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7ee0a-8f21-4dc6-9664-f21f46f5350e', 'volume_name': 'volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3414774-3874-4fd0-b2df-6e50a46249e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3414774-3874-4fd0-b2df-6e50a46249e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2932d4-33b2-455d-939c-2b6ff07b5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Volume 53b7ee0a-8f21-4dc6-9664-f21f46f5350e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e', 'volume_size': 1}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1148558959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7ee0a-8f21-4dc6-9664-f21f46f5350e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:28Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Creating volume 53b7ee0a-8f21-4dc6-9664-f21f46f5350e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:27 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:27 devstack sudo[99742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e 1073741824
Sep 25 17:11:27 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:28 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e 1073741824" returned: 0 in 0.651s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:28 devstack sudo[99752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e
Sep 25 17:11:28 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:28 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" returned: 0 in 0.337s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2932d4-33b2-455d-939c-2b6ff07b5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a006da03-1feb-4c1d-b154-221b9def0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Volume volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e (53b7ee0a-8f21-4dc6-9664-f21f46f5350e): created successfully
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a006da03-1feb-4c1d-b154-221b9def0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (a4539ff5-99b6-44c9-9c96-b8dbfebd1706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b3bcbbad-c117-49b7-bd79-e5a73f5b6071 tempest-VolumesListAdminTestJSON-1623715599 None] Created volume successfully.
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (d06cd643-90d9-48e8-bf2e-d9588113a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc2de1-88b8-4c23-9e5a-6d9300e50b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc2de1-88b8-4c23-9e5a-6d9300e50b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-375139926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786d7bb0-a64a-424f-9ab3-3cd102e512b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:31Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d943c9-b5fa-4a56-a628-3bf4e2cea9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d943c9-b5fa-4a56-a628-3bf4e2cea9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ab1e16-2a96-4f55-b8a1-3f348e83bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ab1e16-2a96-4f55-b8a1-3f348e83bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786d7bb0-a64a-424f-9ab3-3cd102e512b9', 'volume_name': 'volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf3ea33-2df2-47a3-aecf-6bef0f143f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf3ea33-2df2-47a3-aecf-6bef0f143f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8758195d-6101-4602-948e-e0813c998b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Volume 786d7bb0-a64a-424f-9ab3-3cd102e512b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9', 'volume_size': 1}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-375139926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786d7bb0-a64a-424f-9ab3-3cd102e512b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:31Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Creating volume 786d7bb0-a64a-424f-9ab3-3cd102e512b9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:30 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 1073741824
Sep 25 17:11:30 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:31 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 1073741824" returned: 0 in 0.541s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:31 devstack sudo[99827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9
Sep 25 17:11:31 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:31 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9" returned: 0 in 0.354s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8758195d-6101-4602-948e-e0813c998b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96cea60-6040-4831-92ee-6358ec2c47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Volume volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 (786d7bb0-a64a-424f-9ab3-3cd102e512b9): created successfully
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96cea60-6040-4831-92ee-6358ec2c47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (d06cd643-90d9-48e8-bf2e-d9588113a25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4091c54f-1560-475e-b4c5-ee5f49a2be85 tempest-VolumesListAdminTestJSON-1623715599 None] Created volume successfully.
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (0c95725a-1872-4c39-81e0-7d0f00af6581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387dd687-dc88-434e-ad83-0e56aa17106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387dd687-dc88-434e-ad83-0e56aa17106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-586806786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce75bfd2-5c05-489f-86d1-20927015f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:33Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdf3cf2-e131-4bbf-be2d-c91c81e1bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdf3cf2-e131-4bbf-be2d-c91c81e1bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491a009d-d8a7-4ea7-b65c-26b48850140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491a009d-d8a7-4ea7-b65c-26b48850140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce75bfd2-5c05-489f-86d1-20927015f246', 'volume_name': 'volume-ce75bfd2-5c05-489f-86d1-20927015f246', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b9cde-35ae-44f9-a902-6a75dc27a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b9cde-35ae-44f9-a902-6a75dc27a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856883e4-2a2e-4854-81c4-3dfd3c92c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Volume ce75bfd2-5c05-489f-86d1-20927015f246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce75bfd2-5c05-489f-86d1-20927015f246', 'volume_size': 1}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-586806786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce75bfd2-5c05-489f-86d1-20927015f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae2ffa1f6a248d982b5dec20e44afc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:33Z,use_quota=True,user_id='e9addd56ecb046a9859f5b15f73c20ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Creating volume ce75bfd2-5c05-489f-86d1-20927015f246 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:33 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:33 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 1073741824
Sep 25 17:11:33 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:34 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 1073741824" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:34 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246
Sep 25 17:11:34 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:34 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246" returned: 0 in 0.358s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856883e4-2a2e-4854-81c4-3dfd3c92c399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce75bfd2-5c05-489f-86d1-20927015f246', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc9d3c-11e0-4e1a-87a3-4cc54104f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Volume volume-ce75bfd2-5c05-489f-86d1-20927015f246 (ce75bfd2-5c05-489f-86d1-20927015f246): created successfully
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc9d3c-11e0-4e1a-87a3-4cc54104f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Flow 'volume_create_manager' (0c95725a-1872-4c39-81e0-7d0f00af6581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b0289afc-06cd-4bcc-8f39-f6189b93fbae tempest-VolumesListAdminTestJSON-1623715599 None] Created volume successfully.
Sep 25 17:11:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-eef40b76-c006-48c2-9d93-0b87f159f3f8 req-d8ef575f-6734-4b7c-83d6-e9bffed24c67 tempest-AttachVolumeNegativeTest-1419689403 None] Terminate volume connection completed successfully.
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-eef40b76-c006-48c2-9d93-0b87f159f3f8 req-d8ef575f-6734-4b7c-83d6-e9bffed24c67 tempest-AttachVolumeNegativeTest-1419689403 None] Deleting attachment 7bf26e13-ffa5-4855-acfc-628b078f20b5. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Flow 'volume_create_manager' (a9dd1d38-ef89-408a-a45d-6308b095be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4518212-c70a-4599-badf-7175a5881f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4518212-c70a-4599-badf-7175a5881f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969f4dc8-aeb9-4a42-b80b-c1e2df2843b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ee42ad11b14448f84c075f1bcd07c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:37Z,use_quota=True,user_id='b0d65bf6983840ea95c68a7a9e8843d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2d1daf-0774-4a45-aef9-beff0d5db9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2d1daf-0774-4a45-aef9-beff0d5db9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a64518-aeb4-401a-93ba-f9fd3a523a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a64518-aeb4-401a-93ba-f9fd3a523a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969f4dc8-aeb9-4a42-b80b-c1e2df2843b6', 'volume_name': 'volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd984566-2eeb-4094-b6d9-fe8a64790d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd984566-2eeb-4094-b6d9-fe8a64790d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53952cbd-9fe0-48f4-9568-9a767de64150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Volume 969f4dc8-aeb9-4a42-b80b-c1e2df2843b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6', 'volume_size': 1}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969f4dc8-aeb9-4a42-b80b-c1e2df2843b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ee42ad11b14448f84c075f1bcd07c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:37Z,use_quota=True,user_id='b0d65bf6983840ea95c68a7a9e8843d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Creating volume 969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:37 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 1073741824
Sep 25 17:11:37 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:38 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 1073741824" returned: 0 in 0.815s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:38 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6
Sep 25 17:11:38 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:38 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53952cbd-9fe0-48f4-9568-9a767de64150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b25c95-5f2c-4a4a-9a51-e2744578cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Volume volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 (969f4dc8-aeb9-4a42-b80b-c1e2df2843b6): created successfully
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b25c95-5f2c-4a4a-9a51-e2744578cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Flow 'volume_create_manager' (a9dd1d38-ef89-408a-a45d-6308b095be8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d9d20c9b-11b1-4057-9012-bfd178fb69bf tempest-VolumesListAdminTestJSON-1870366044 None] Created volume successfully.
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Acquiring lock "cinder-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "cinder-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Acquiring lock "cinder-quobyte-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "cinder-quobyte-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe2883-dd5b-4c16-b19e-fe805ddb6668]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-ce75bfd2-5c05-489f-86d1-20927015f246-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-ce75bfd2-5c05-489f-86d1-20927015f246-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:40 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6
Sep 25 17:11:40 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-quobyte-ce75bfd2-5c05-489f-86d1-20927015f246" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-ce75bfd2-5c05-489f-86d1-20927015f246" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220e5e3-45f3-4d84-b973-9c15a7909783]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:40 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246
Sep 25 17:11:40 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:40 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:40 devstack sudo[99975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6
Sep 25 17:11:40 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:41 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:41 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246
Sep 25 17:11:41 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:41 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" returned: 0 in 0.509s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "cinder-quobyte-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6" released by "delete_volume" :: held 1.355s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Created reservations ['a1ea8e29-a350-418a-856f-388875114937', '40890227-836a-4ece-863a-65f6fec70dc5', '72834ecd-db74-4f55-8286-978b3e65cd1a', '1126b26d-1cff-4616-8d1b-1f09e82006d2'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:41 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:11:41 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:41 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce75bfd2-5c05-489f-86d1-20927015f246" returned: 0 in 0.639s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-ce75bfd2-5c05-489f-86d1-20927015f246" released by "delete_volume" :: held 1.415s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Created reservations ['e8fd344e-1b63-421b-853b-1fc43c9fc063', '065e2c13-b470-4efc-89b2-7bb6a8563628', 'aaea017e-6cc5-45b4-882a-34ecbf16ab00', 'd204870d-f612-4484-b64b-6d10ca411c08'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:41 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:11:41 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:42 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.460s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:11:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Deleted volume successfully.
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f00e9214-b780-485b-88e3-8ba556e23f5b tempest-VolumesListAdminTestJSON-1870366044 None] Lock "cinder-969f4dc8-aeb9-4a42-b80b-c1e2df2843b6-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:42 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.553s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:11:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Deleted volume successfully.
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b9b11d7-4196-42fb-b762-6d64671b8f73 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-ce75bfd2-5c05-489f-86d1-20927015f246-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-786d7bb0-a64a-424f-9ab3-3cd102e512b9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-786d7bb0-a64a-424f-9ab3-3cd102e512b9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-quobyte-786d7bb0-a64a-424f-9ab3-3cd102e512b9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-786d7bb0-a64a-424f-9ab3-3cd102e512b9" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[339fcca7-30df-4eb0-902c-8cc33481b4d3]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:43 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9
Sep 25 17:11:43 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:43 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:43 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9
Sep 25 17:11:43 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:44 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-786d7bb0-a64a-424f-9ab3-3cd102e512b9" returned: 0 in 0.700s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-786d7bb0-a64a-424f-9ab3-3cd102e512b9" released by "delete_volume" :: held 1.494s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Created reservations ['f3ef8b13-4b87-4096-af4c-6c7e3609f7fa', '14fd5f5e-1962-48d7-b0da-3d8cfb4b4dfb', '5b7c3d09-de15-4c15-894d-6033eb459c7e', '1883e408-f8a8-4b59-a5ab-1e5001815f22'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:44 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:11:44 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:44 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.366s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:11:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Deleted volume successfully.
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f5cfa12-9b7d-4f54-ae8f-d3cb6eea1c93 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-786d7bb0-a64a-424f-9ab3-3cd102e512b9-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-53b7ee0a-8f21-4dc6-9664-f21f46f5350e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-53b7ee0a-8f21-4dc6-9664-f21f46f5350e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "cinder-quobyte-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780009e-9d76-4c80-b630-431c5bca19b6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:45 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e
Sep 25 17:11:45 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:45 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" returned: 0 in 0.454s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:45 devstack sudo[100013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e
Sep 25 17:11:45 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:46 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" returned: 0 in 0.478s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-quobyte-53b7ee0a-8f21-4dc6-9664-f21f46f5350e" released by "delete_volume" :: held 0.989s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Created reservations ['bb9d5c78-6065-4a8f-a29b-06c7b188168f', 'f7a024d4-6c53-4f44-bb84-32988f45fda7', 'c161aef1-26b7-463e-8e21-f7a1454eb690', 'd3f0935a-83b9-4198-b7c6-4c53f41f4fa0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:46 devstack sudo[100016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:11:46 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:46 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.329s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:11:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Deleted volume successfully.
Sep 25 17:11:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0e911ad-f797-46de-9e9a-bef5c9532c59 tempest-VolumesListAdminTestJSON-1623715599 None] Lock "cinder-53b7ee0a-8f21-4dc6-9664-f21f46f5350e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Flow 'volume_create_manager' (3e19c4c1-6597-4e7e-9f41-7ba28dcbbcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4c657-6595-48d1-be3e-7da3b84b15dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4c657-6595-48d1-be3e-7da3b84b15dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-203260628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f3ba07-798b-4d8d-9649-d79df9217108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3ee462a32f4d4aab159a546cc1fea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:50Z,use_quota=True,user_id='d6c5dd01ec7b4465a4123ac073d57a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ae9f11-1f1b-44ad-86f4-4767976c2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ae9f11-1f1b-44ad-86f4-4767976c2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951c7a9-43ec-474a-bea3-1eb598cd7daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:49 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951c7a9-43ec-474a-bea3-1eb598cd7daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2f3ba07-798b-4d8d-9649-d79df9217108', 'volume_name': 'volume-b2f3ba07-798b-4d8d-9649-d79df9217108', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4809165d0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307b3497-c35e-4c14-843e-0555442e7091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307b3497-c35e-4c14-843e-0555442e7091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cf712b-bc3e-40dd-a35a-2bf59b0856ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Volume b2f3ba07-798b-4d8d-9649-d79df9217108: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2f3ba07-798b-4d8d-9649-d79df9217108', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4809165d0>}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Trying to clone b2f3ba07-798b-4d8d-9649-d79df9217108 from image 21fcf20c-2aec-48a7-986a-08b11deee77e at location (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:11:50 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[db32981d-a2f6-4af6-bf4d-d95c070ce5d4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:50 devstack sudo[100056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD
Sep 25 17:11:50 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:51 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e is fetched for user d6c5dd01ec7b4465a4123ac073d57a1c. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc4026-b356-4199-8b1d-822d5a34214c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:51 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD
Sep 25 17:11:51 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:51 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-203260628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f3ba07-798b-4d8d-9649-d79df9217108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3ee462a32f4d4aab159a546cc1fea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:50Z,use_quota=True,user_id='d6c5dd01ec7b4465a4123ac073d57a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Creating volume b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:51 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1073741824
Sep 25 17:11:51 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:52 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1073741824" returned: 0 in 0.591s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:52 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108
Sep 25 17:11:52 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:52 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108" returned: 0 in 0.280s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Attempting download of 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume b2f3ba07-798b-4d8d-9649-d79df9217108. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2346e49a-a753-40de-a280-7bc99b3e28aa]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:52 devstack sudo[100079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw
Sep 25 17:11:52 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:53 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw" returned: 0 in 0.451s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:53 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw
Sep 25 17:11:53 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:53 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw" returned: 1 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21fcf20c-2aec-48a7-986a-08b11deee77e_ty69l3bw' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f2f81-3d22-4fbb-9c60-5f68bab55dd9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:53 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD
Sep 25 17:11:53 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] 21fcf20c-2aec-48a7-986a-08b11deee77e was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:11:53 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:53 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108
Sep 25 17:11:53 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108" returned: 0 in 2.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:56 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21fcf20c-2aec-48a7-986a-08b11deee77e_y3kwutypdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:11:56 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Converted 112.00 MB image at 41.98 MB/s
Sep 25 17:11:56 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:56 devstack sudo[100118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1G
Sep 25 17:11:56 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:11:57 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 1G" returned: 0 in 0.871s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Downloaded image 21fcf20c-2aec-48a7-986a-08b11deee77e ((None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}])) to volume b2f3ba07-798b-4d8d-9649-d79df9217108 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Temporary image 21fcf20c-2aec-48a7-986a-08b11deee77e for user d6c5dd01ec7b4465a4123ac073d57a1c is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Marking volume b2f3ba07-798b-4d8d-9649-d79df9217108 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Copying metadata from image 21fcf20c-2aec-48a7-986a-08b11deee77e to b2f3ba07-798b-4d8d-9649-d79df9217108. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Creating volume glance metadata for volume b2f3ba07-798b-4d8d-9649-d79df9217108 backed by image 21fcf20c-2aec-48a7-986a-08b11deee77e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cf712b-bc3e-40dd-a35a-2bf59b0856ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f3ba07-798b-4d8d-9649-d79df9217108', 'volume_size': 1, 'image_id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21fcf20c-2aec-48a7-986a-08b11deee77e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c001231978be438085cd54aa60a94e70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '21fcf20c-2aec-48a7-986a-08b11deee77e', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21fcf20c-2aec-48a7-986a-08b11deee77e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a4809165d0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8342d6e3-7be7-4ff3-9660-ef1d29284a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Volume volume-b2f3ba07-798b-4d8d-9649-d79df9217108 (b2f3ba07-798b-4d8d-9649-d79df9217108): created successfully
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8342d6e3-7be7-4ff3-9660-ef1d29284a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Flow 'volume_create_manager' (3e19c4c1-6597-4e7e-9f41-7ba28dcbbcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5a663a06-8a98-4ae0-896d-b9774fa138b8 tempest-TestShelveInstance-1679220079 None] Created volume successfully.
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Flow 'volume_create_manager' (d2a5fece-1eb8-4a1f-9806-bfe9a1109665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ba5ab-fdb6-49d0-9974-efafc74e88f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ba5ab-fdb6-49d0-9974-efafc74e88f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1089640293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d288b9-4ab3-44be-abd2-1ce086e66278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acf7bc2e24e40f3b1d6385b9fcd16ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:59Z,use_quota=True,user_id='6e97f153c07144f596791d1027fc1351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4837cae3-8399-412d-b5e3-9e1a23362f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4837cae3-8399-412d-b5e3-9e1a23362f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cced3b-f654-4d5b-8be5-f8bf2f3f6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cced3b-f654-4d5b-8be5-f8bf2f3f6fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d288b9-4ab3-44be-abd2-1ce086e66278', 'volume_name': 'volume-94d288b9-4ab3-44be-abd2-1ce086e66278', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fec838-290e-4b6b-9634-539cf2ad33f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fec838-290e-4b6b-9634-539cf2ad33f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae93a971-bcdc-4518-b069-118458c200e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:11:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Volume 94d288b9-4ab3-44be-abd2-1ce086e66278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d288b9-4ab3-44be-abd2-1ce086e66278', 'volume_size': 2}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1089640293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d288b9-4ab3-44be-abd2-1ce086e66278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acf7bc2e24e40f3b1d6385b9fcd16ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:59Z,use_quota=True,user_id='6e97f153c07144f596791d1027fc1351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Creating volume 94d288b9-4ab3-44be-abd2-1ce086e66278 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:11:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:11:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 2147483648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:11:59 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 2147483648
Sep 25 17:11:59 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:00 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 2147483648" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:00 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278
Sep 25 17:12:00 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:00 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278" returned: 0 in 0.287s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae93a971-bcdc-4518-b069-118458c200e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d288b9-4ab3-44be-abd2-1ce086e66278', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb366e-8fd5-414e-9d90-2c4bcca77a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Volume volume-94d288b9-4ab3-44be-abd2-1ce086e66278 (94d288b9-4ab3-44be-abd2-1ce086e66278): created successfully
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb366e-8fd5-414e-9d90-2c4bcca77a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Flow 'volume_create_manager' (d2a5fece-1eb8-4a1f-9806-bfe9a1109665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f6a3e3b9-b06d-4dcc-81b4-12f983b735eb tempest-VolumesCloneNegativeTest-1940034963 None] Created volume successfully.
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f8f56649-b228-4193-bcf8-516a242f1746 req-e8875818-eb6a-4474-9f0d-33222310b514 tempest-TestShelveInstance-1679220079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f8f56649-b228-4193-bcf8-516a242f1746 req-e8875818-eb6a-4474-9f0d-33222310b514 tempest-TestShelveInstance-1679220079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f8f56649-b228-4193-bcf8-516a242f1746 req-e8875818-eb6a-4474-9f0d-33222310b514 tempest-TestShelveInstance-1679220079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f8f56649-b228-4193-bcf8-516a242f1746 req-e8875818-eb6a-4474-9f0d-33222310b514 tempest-TestShelveInstance-1679220079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-b2f3ba07-798b-4d8d-9649-d79df9217108', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9ac2f68-3dd9-42c3-aa80-bdf0a02f0564', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Acquiring lock "cinder-94d288b9-4ab3-44be-abd2-1ce086e66278-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "cinder-94d288b9-4ab3-44be-abd2-1ce086e66278-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f8f56649-b228-4193-bcf8-516a242f1746 req-e8875818-eb6a-4474-9f0d-33222310b514 tempest-TestShelveInstance-1679220079 None] attachment_update completed successfully.
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Acquiring lock "cinder-quobyte-94d288b9-4ab3-44be-abd2-1ce086e66278" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "cinder-quobyte-94d288b9-4ab3-44be-abd2-1ce086e66278" acquired by "delete_volume" :: waited 0.049s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74327d8-6366-44b6-9ad5-9a4b23c5dce4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:02 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278
Sep 25 17:12:02 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:02 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278" returned: 0 in 0.591s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:02 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278
Sep 25 17:12:02 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:03 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94d288b9-4ab3-44be-abd2-1ce086e66278" returned: 0 in 0.341s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "cinder-quobyte-94d288b9-4ab3-44be-abd2-1ce086e66278" released by "delete_volume" :: held 1.095s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Created reservations ['984e51ee-c0f7-43ca-bbc5-17ddbe47f34a', '336aa3db-cab0-4f37-95a9-e2e6230187bc', 'cea15072-04a7-4a7e-8e61-05f6846ee530', '65778346-3d55-4853-9afa-b7d279aad2f5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:03 devstack sudo[100239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:03 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:03 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:03 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:03 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.553s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Deleted volume successfully.
Sep 25 17:12:04 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.435s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:12:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1563b125-12f8-449b-93bc-f53d20c3c0c2 tempest-VolumesCloneNegativeTest-1940034963 None] Lock "cinder-94d288b9-4ab3-44be-abd2-1ce086e66278-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Flow 'volume_create_manager' (e91f4664-c238-4e3e-b3fd-8a3acfc5b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8074e6e-a154-4f47-9d1c-448c5895e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8074e6e-a154-4f47-9d1c-448c5895e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-278117071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d872312e-d1ed-4ee5-8d58-cb8b05a93b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0474d989f3ba4c44abc86bc81f688421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:05Z,use_quota=True,user_id='a818047dfd8e4317a8f4171ff634d398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350124ae-c7bd-4b66-b6aa-99de8a7011fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350124ae-c7bd-4b66-b6aa-99de8a7011fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6928849-60d9-43fc-948d-55b3893099f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6928849-60d9-43fc-948d-55b3893099f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd872312e-d1ed-4ee5-8d58-cb8b05a93b5a', 'volume_name': 'volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea1f40c-c558-4097-861d-4eaee897edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea1f40c-c558-4097-861d-4eaee897edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805e27f-2975-447d-bdc5-d00978b12d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Volume d872312e-d1ed-4ee5-8d58-cb8b05a93b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a', 'volume_size': 1}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-278117071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d872312e-d1ed-4ee5-8d58-cb8b05a93b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0474d989f3ba4c44abc86bc81f688421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:05Z,use_quota=True,user_id='a818047dfd8e4317a8f4171ff634d398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Creating volume d872312e-d1ed-4ee5-8d58-cb8b05a93b5a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:05 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a 1073741824
Sep 25 17:12:05 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:06 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a 1073741824" returned: 0 in 0.708s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:06 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a
Sep 25 17:12:06 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:06 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0805e27f-2975-447d-bdc5-d00978b12d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a7fe2-2394-4de9-a80d-6f9db062a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Volume volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a (d872312e-d1ed-4ee5-8d58-cb8b05a93b5a): created successfully
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a7fe2-2394-4de9-a80d-6f9db062a13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Flow 'volume_create_manager' (e91f4664-c238-4e3e-b3fd-8a3acfc5b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5bd9e994-492e-4d7e-abcd-6d83ee976378 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Created volume successfully.
Sep 25 17:12:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-57958367-25e9-4a8f-9132-7174ce6e4dad req-7f7b2939-477f-4920-835a-b79f6097cc07 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-57958367-25e9-4a8f-9132-7174ce6e4dad req-7f7b2939-477f-4920-835a-b79f6097cc07 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-57958367-25e9-4a8f-9132-7174ce6e4dad req-7f7b2939-477f-4920-835a-b79f6097cc07 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-57958367-25e9-4a8f-9132-7174ce6e4dad req-7f7b2939-477f-4920-835a-b79f6097cc07 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1093bf30-2639-4624-a2fb-c4d03492a652', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:12:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-57958367-25e9-4a8f-9132-7174ce6e4dad req-7f7b2939-477f-4920-835a-b79f6097cc07 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] attachment_update completed successfully.
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (6a96f7e7-ec74-4c94-9f0d-8691a0e6815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c4ec67-b2f1-470f-b302-537325762dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c4ec67-b2f1-470f-b302-537325762dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2097492531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975e1ebd-d938-4deb-b1e5-770c3cd7952f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:12Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3619a84c-d1e2-4499-b78e-04bc681ee6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3619a84c-d1e2-4499-b78e-04bc681ee6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448101df-7542-42f3-8a84-284381913018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448101df-7542-42f3-8a84-284381913018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975e1ebd-d938-4deb-b1e5-770c3cd7952f', 'volume_name': 'volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d93474a-e4ef-4d4e-8c8e-fe1c4716a1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d93474a-e4ef-4d4e-8c8e-fe1c4716a1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f0d27-d6a4-4cff-8855-299216c98253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Volume 975e1ebd-d938-4deb-b1e5-770c3cd7952f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f', 'volume_size': 1}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2097492531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975e1ebd-d938-4deb-b1e5-770c3cd7952f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:12Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Creating volume 975e1ebd-d938-4deb-b1e5-770c3cd7952f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:12 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f 1073741824
Sep 25 17:12:12 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:13 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f 1073741824" returned: 0 in 0.695s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:13 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f
Sep 25 17:12:13 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-279b26f8-9973-45fe-bf1e-a2f02322d14b req-d637769e-5dd2-4c9c-b6b9-decd31d21b77 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Terminate volume connection completed successfully.
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-279b26f8-9973-45fe-bf1e-a2f02322d14b req-d637769e-5dd2-4c9c-b6b9-decd31d21b77 tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Deleting attachment 1093bf30-2639-4624-a2fb-c4d03492a652. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:12:13 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f" returned: 0 in 0.332s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f0d27-d6a4-4cff-8855-299216c98253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b69cfb-7531-4a73-b4ec-338ebae912f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Volume volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f (975e1ebd-d938-4deb-b1e5-770c3cd7952f): created successfully
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b69cfb-7531-4a73-b4ec-338ebae912f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (6a96f7e7-ec74-4c94-9f0d-8691a0e6815e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91d21173-f9ff-4530-ad8d-9452f5398561 tempest-VolumesListTestJSON-1800425556 None] Created volume successfully.
Sep 25 17:12:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "cinder-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "cinder-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "cinder-quobyte-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "cinder-quobyte-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a82a9-5e6d-40d9-aabd-a2774a868d03]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:14 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a
Sep 25 17:12:14 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:14 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" returned: 0 in 0.539s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:14 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a
Sep 25 17:12:14 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (bbe7b91a-e34b-43c2-a514-44d1fb3c391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa15f361-fe48-4f22-b05e-58013ca4af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa15f361-fe48-4f22-b05e-58013ca4af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222308906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:15Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b92a33-75cb-448f-a81c-430d9bfa270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b92a33-75cb-448f-a81c-430d9bfa270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67cf263-7392-40cf-99cd-da24e7d39d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67cf263-7392-40cf-99cd-da24e7d39d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a', 'volume_name': 'volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5924b33-761c-4714-bcc5-5709df4306a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5924b33-761c-4714-bcc5-5709df4306a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd665b-3fea-4236-928b-f7c42be761c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Volume 522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a', 'volume_size': 1}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222308906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:15Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Creating volume 522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:15 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" returned: 0 in 0.521s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:15 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a 1073741824
Sep 25 17:12:15 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "cinder-quobyte-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a" released by "delete_volume" :: held 1.146s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Created reservations ['2a27196f-1e60-471a-880d-188927a9fc26', '9a03a172-7ea6-4f99-b38e-e88a7c03b25a', 'b574a297-6ff0-4b4d-9b3b-99667df0f960', 'c17668c7-e687-4404-bccc-8e4ecf1863aa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:15 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:15 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:15 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Deleted volume successfully.
Sep 25 17:12:15 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a66e7752-252a-48e0-a74f-dfc1d403417a tempest-TestServerVolumeAttachScenarioOldVersion-324263527 None] Lock "cinder-d872312e-d1ed-4ee5-8d58-cb8b05a93b5a-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a 1073741824" returned: 0 in 0.678s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:15 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a
Sep 25 17:12:15 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:16 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd665b-3fea-4236-928b-f7c42be761c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2ce36-c28c-4f28-b594-9e1f8c1b2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Volume volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a (522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a): created successfully
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2ce36-c28c-4f28-b594-9e1f8c1b2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (bbe7b91a-e34b-43c2-a514-44d1fb3c391e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5caaebcd-b220-44d6-9f54-90933a950c19 tempest-VolumesListTestJSON-1800425556 None] Created volume successfully.
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (f79a32d4-bee3-47c6-887d-ed124bcc14f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e29c767-35ba-470b-8784-8e2886b301dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e29c767-35ba-470b-8784-8e2886b301dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-857999843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977f5e36-7b61-418f-bba5-98b28e27631a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:19Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7f2f03-6fb1-4e26-b191-f2ded9515bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7f2f03-6fb1-4e26-b191-f2ded9515bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca3743-41ae-4c19-981d-6889aac7d728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca3743-41ae-4c19-981d-6889aac7d728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977f5e36-7b61-418f-bba5-98b28e27631a', 'volume_name': 'volume-977f5e36-7b61-418f-bba5-98b28e27631a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9793d4-b3cc-44cf-8f94-11ba03a63de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9793d4-b3cc-44cf-8f94-11ba03a63de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa944401-5a3d-4d20-8514-4317ba37db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Volume 977f5e36-7b61-418f-bba5-98b28e27631a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977f5e36-7b61-418f-bba5-98b28e27631a', 'volume_size': 1}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-857999843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977f5e36-7b61-418f-bba5-98b28e27631a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76e15afb306047f1b1aa56aa02b5a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:19Z,use_quota=True,user_id='67bfee69c4c6493ba5adf3c8a42ad750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Creating volume 977f5e36-7b61-418f-bba5-98b28e27631a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:18 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a 1073741824
Sep 25 17:12:18 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:19 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a 1073741824" returned: 0 in 0.726s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:19 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a
Sep 25 17:12:19 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:19 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a" returned: 0 in 0.291s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa944401-5a3d-4d20-8514-4317ba37db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977f5e36-7b61-418f-bba5-98b28e27631a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c9292-a81e-4406-a387-23b57cea5872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Volume volume-977f5e36-7b61-418f-bba5-98b28e27631a (977f5e36-7b61-418f-bba5-98b28e27631a): created successfully
Sep 25 17:12:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c9292-a81e-4406-a387-23b57cea5872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Flow 'volume_create_manager' (f79a32d4-bee3-47c6-887d-ed124bcc14f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6f3d8e7f-2d43-4b65-8d7a-5b2aac5c665b tempest-VolumesListTestJSON-1800425556 None] Created volume successfully.
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-977f5e36-7b61-418f-bba5-98b28e27631a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-977f5e36-7b61-418f-bba5-98b28e27631a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-quobyte-977f5e36-7b61-418f-bba5-98b28e27631a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-977f5e36-7b61-418f-bba5-98b28e27631a" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7693f9-b027-4fa3-8f8f-bfb0427f2b04]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:12:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:24 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a
Sep 25 17:12:24 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:24 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a" returned: 0 in 0.564s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:24 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a
Sep 25 17:12:24 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:24 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-977f5e36-7b61-418f-bba5-98b28e27631a" returned: 0 in 0.366s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-977f5e36-7b61-418f-bba5-98b28e27631a" released by "delete_volume" :: held 0.989s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=77,cinder:UPDATE=79,cinder:DELETE=5,cinder:INSERT=22 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:12:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=73,cinder:UPDATE=88,cinder:INSERT=25,cinder:DELETE=11 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Created reservations ['635f2458-6f0b-492e-ab88-4e74380d5a01', '18c020c8-bb60-4c94-a523-ee19a644442f', 'b12f26f9-f63b-45e6-85be-8426f8ba967b', '28f9ac48-139f-4e4e-b4e2-f53679966242'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:25 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:25 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (d7c852b8-88f7-41db-ba43-40ea104bb18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34704b31-29f1-4296-b566-73a94e4a3e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34704b31-29f1-4296-b566-73a94e4a3e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-570483377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8787bb-daa6-4001-b990-d2a31dd378dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:25Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988cb54-2dd9-4426-9096-1794136e758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a988cb54-2dd9-4426-9096-1794136e758a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd40ba2-b4c4-41cf-bbd3-90df54bbed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd40ba2-b4c4-41cf-bbd3-90df54bbed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8787bb-daa6-4001-b990-d2a31dd378dc', 'volume_name': 'volume-9f8787bb-daa6-4001-b990-d2a31dd378dc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7738512f-9833-42e1-8c54-b821a2888e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7738512f-9833-42e1-8c54-b821a2888e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1046aacb-22a3-48a6-acfd-aa1f776bc54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Volume 9f8787bb-daa6-4001-b990-d2a31dd378dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8787bb-daa6-4001-b990-d2a31dd378dc', 'volume_size': 1}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-570483377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8787bb-daa6-4001-b990-d2a31dd378dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:25Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Creating volume 9f8787bb-daa6-4001-b990-d2a31dd378dc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:25 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc 1073741824
Sep 25 17:12:25 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:25 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.330s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Deleted volume successfully.
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc51bc46-814c-4981-84b2-5fc281f14d15 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-977f5e36-7b61-418f-bba5-98b28e27631a-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:25 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc 1073741824" returned: 0 in 0.549s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:26 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc
Sep 25 17:12:26 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:26 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1046aacb-22a3-48a6-acfd-aa1f776bc54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8787bb-daa6-4001-b990-d2a31dd378dc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b831d895-da80-4b35-b633-790232b8173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Volume volume-9f8787bb-daa6-4001-b990-d2a31dd378dc (9f8787bb-daa6-4001-b990-d2a31dd378dc): created successfully
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b831d895-da80-4b35-b633-790232b8173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (d7c852b8-88f7-41db-ba43-40ea104bb18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cdefe5c7-9be8-49f6-99e7-ecba52dcbe3f tempest-AttachVolumeNegativeTest-1419689403 None] Created volume successfully.
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-quobyte-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b681eaf-7a4e-49a5-a4aa-b8dfe132715a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:26 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a
Sep 25 17:12:26 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:26 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:26 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a
Sep 25 17:12:26 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:27 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" returned: 0 in 0.363s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a" released by "delete_volume" :: held 0.891s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Created reservations ['0f9516ef-8f96-438e-91c8-f82188120fb3', '3fea84a7-d252-4220-995b-bbdaca600922', '884b409b-a5be-419c-a0c4-c165bac35511', '77a18224-9312-48f5-a7aa-96ff69dc7455'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:27 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:27 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-975e1ebd-d938-4deb-b1e5-770c3cd7952f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-975e1ebd-d938-4deb-b1e5-770c3cd7952f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:27 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.381s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Deleted volume successfully.
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "cinder-quobyte-975e1ebd-d938-4deb-b1e5-770c3cd7952f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:12:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-975e1ebd-d938-4deb-b1e5-770c3cd7952f" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6c0bf72-10dd-4035-809f-8cc8cff92de3 tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-522accbe-c2cf-4ffd-8a7b-a28f3f5a8e2a-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee41ec35-702e-4722-b081-01ffe00f5c2a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:28 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f
Sep 25 17:12:28 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4fee13f0-b328-4683-9c9d-728da3de05f6 req-a28e7bbd-f81e-4c75-ac13-4c20cb105dcf tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4fee13f0-b328-4683-9c9d-728da3de05f6 req-a28e7bbd-f81e-4c75-ac13-4c20cb105dcf tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4fee13f0-b328-4683-9c9d-728da3de05f6 req-a28e7bbd-f81e-4c75-ac13-4c20cb105dcf tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:28 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:28 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f
Sep 25 17:12:28 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-4fee13f0-b328-4683-9c9d-728da3de05f6 req-a28e7bbd-f81e-4c75-ac13-4c20cb105dcf tempest-AttachVolumeNegativeTest-1419689403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-9f8787bb-daa6-4001-b990-d2a31dd378dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a23178d-12fb-4aca-ab80-5036cafc539e', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:12:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-4fee13f0-b328-4683-9c9d-728da3de05f6 req-a28e7bbd-f81e-4c75-ac13-4c20cb105dcf tempest-AttachVolumeNegativeTest-1419689403 None] attachment_update completed successfully.
Sep 25 17:12:29 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-975e1ebd-d938-4deb-b1e5-770c3cd7952f" returned: 0 in 0.556s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-quobyte-975e1ebd-d938-4deb-b1e5-770c3cd7952f" released by "delete_volume" :: held 1.281s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Created reservations ['f6daac1c-6720-4531-b399-7a6eb32c0cc0', 'ef39ae58-63ae-4778-81eb-6cc65eed85ef', '3da69a36-444d-4349-9622-f925321d730a', '02c5ad7a-e507-446c-a868-e9e7e250e068'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:29 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:12:29 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:29 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.357s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:12:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Deleted volume successfully.
Sep 25 17:12:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0179252b-e493-431e-a4b6-66ad69e8a5fa tempest-VolumesListTestJSON-1800425556 None] Lock "cinder-975e1ebd-d938-4deb-b1e5-770c3cd7952f-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:12:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-df69157a-7af1-468f-958c-b7ed5c13e8f9 req-97c3d43e-2a05-40d9-b342-32c57b8eb464 tempest-AttachVolumeNegativeTest-1419689403 None] Terminate volume connection completed successfully.
Sep 25 17:12:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-df69157a-7af1-468f-958c-b7ed5c13e8f9 req-97c3d43e-2a05-40d9-b342-32c57b8eb464 tempest-AttachVolumeNegativeTest-1419689403 None] Deleting attachment 0a23178d-12fb-4aca-ab80-5036cafc539e. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Flow 'volume_create_manager' (f1d5f3f3-9820-4639-8e6e-9d9a1a92fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3a07d3-7664-4a4f-84ea-8c90e90ce012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3a07d3-7664-4a4f-84ea-8c90e90ce012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054618921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8189b99d-3232-4631-8893-ab38c343b1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da36488a567401eab5c3020b82ed8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:35Z,use_quota=True,user_id='923bdb62518749d6b02a952e95e7ba75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfd3dfb-ec1e-4ac9-89a1-97f7d155c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfd3dfb-ec1e-4ac9-89a1-97f7d155c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a153a494-7c7b-4e62-973c-84ebf16369cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a153a494-7c7b-4e62-973c-84ebf16369cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8189b99d-3232-4631-8893-ab38c343b1df', 'volume_name': 'volume-8189b99d-3232-4631-8893-ab38c343b1df', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffadf0-7375-4921-943e-d61435256148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ffadf0-7375-4921-943e-d61435256148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193221dd-cccc-447a-95cb-b0f8f0c2a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Volume 8189b99d-3232-4631-8893-ab38c343b1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8189b99d-3232-4631-8893-ab38c343b1df', 'volume_size': 1}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054618921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8189b99d-3232-4631-8893-ab38c343b1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da36488a567401eab5c3020b82ed8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:35Z,use_quota=True,user_id='923bdb62518749d6b02a952e95e7ba75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Creating volume 8189b99d-3232-4631-8893-ab38c343b1df {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:12:35 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:12:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:35 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df 1073741824
Sep 25 17:12:35 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:36 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df 1073741824" returned: 0 in 0.534s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:12:36 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df
Sep 25 17:12:36 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:12:36 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df" returned: 0 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193221dd-cccc-447a-95cb-b0f8f0c2a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8189b99d-3232-4631-8893-ab38c343b1df', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897c9d86-6102-4a43-9393-0f7642d41ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:12:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Volume volume-8189b99d-3232-4631-8893-ab38c343b1df (8189b99d-3232-4631-8893-ab38c343b1df): created successfully
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897c9d86-6102-4a43-9393-0f7642d41ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:12:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Flow 'volume_create_manager' (f1d5f3f3-9820-4639-8e6e-9d9a1a92fa18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:12:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f227155e-416b-48fb-b780-7bb87d140214 tempest-VolumesNegativeTest-523582531 None] Created volume successfully.
Sep 25 17:12:46 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:12:46 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:INSERT=8,cinder:UPDATE=33,cinder:SELECT=23,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:12:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-a1d46543-b2fd-40d7-b62a-faddcc84767e req-26d8f001-8f59-4e8a-a280-ae86f7e97940 tempest-TestShelveInstance-1679220079 None] Terminate volume connection completed successfully.
Sep 25 17:12:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-a1d46543-b2fd-40d7-b62a-faddcc84767e req-26d8f001-8f59-4e8a-a280-ae86f7e97940 tempest-TestShelveInstance-1679220079 None] Deleting attachment f9ac2f68-3dd9-42c3-aa80-bdf0a02f0564. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:12:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d7b63014-b1cb-40c1-a868-ed0da9dd5e72 req-d8571fab-d182-4b35-8c1b-024a2d54ce5a tempest-TestShelveInstance-1679220079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:12:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d7b63014-b1cb-40c1-a868-ed0da9dd5e72 req-d8571fab-d182-4b35-8c1b-024a2d54ce5a tempest-TestShelveInstance-1679220079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:12:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-d7b63014-b1cb-40c1-a868-ed0da9dd5e72 req-d8571fab-d182-4b35-8c1b-024a2d54ce5a tempest-TestShelveInstance-1679220079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:12:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-d7b63014-b1cb-40c1-a868-ed0da9dd5e72 req-d8571fab-d182-4b35-8c1b-024a2d54ce5a tempest-TestShelveInstance-1679220079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-b2f3ba07-798b-4d8d-9649-d79df9217108', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10b83971-4225-4277-a0eb-9447922fbb61', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:12:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-d7b63014-b1cb-40c1-a868-ed0da9dd5e72 req-d8571fab-d182-4b35-8c1b-024a2d54ce5a tempest-TestShelveInstance-1679220079 None] attachment_update completed successfully.
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:03 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:03 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:04 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:13:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:13:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:13:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:13:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Acquiring lock "cinder-8189b99d-3232-4631-8893-ab38c343b1df-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "cinder-8189b99d-3232-4631-8893-ab38c343b1df-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Acquiring lock "cinder-quobyte-8189b99d-3232-4631-8893-ab38c343b1df" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "cinder-quobyte-8189b99d-3232-4631-8893-ab38c343b1df" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb32d78a-4ad7-4c4e-90bd-3b93f865794a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:11 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df
Sep 25 17:13:11 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:11 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:11 devstack sudo[101855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df
Sep 25 17:13:11 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:12 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-8189b99d-3232-4631-8893-ab38c343b1df" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "cinder-quobyte-8189b99d-3232-4631-8893-ab38c343b1df" released by "delete_volume" :: held 1.265s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Created reservations ['a6eb9719-d7ef-4714-845d-45f67243b281', '49bf0ffb-cf15-4486-a3d9-a91f5fc15cd5', '4720ac45-cbbd-4852-8e7a-94d6f95b2041', '70adee80-6d9b-4bc3-9918-bc10087597e1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:12 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:12 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:12 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.354s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Deleted volume successfully.
Sep 25 17:13:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dedff20c-1e18-40d5-80ce-25c1d3d7b2a3 tempest-VolumesNegativeTest-523582531 None] Lock "cinder-8189b99d-3232-4631-8893-ab38c343b1df-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Flow 'volume_create_manager' (b7edea9b-6ae5-4d71-b27d-90cde6254e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fcd740-3a25-43e3-9bc9-8c463b2a1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fcd740-3a25-43e3-9bc9-8c463b2a1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2019900362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce647e4b-0e06-43e9-8817-6fc11917197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ef95e65c564b759c7e36831dc22c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:17Z,use_quota=True,user_id='6a02c3ed9d684799abe0dcaa161369ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d982680e-8c4f-4b27-96e3-458f80b189e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d982680e-8c4f-4b27-96e3-458f80b189e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7a6c8-f4bd-42a0-be08-afba650e53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7a6c8-f4bd-42a0-be08-afba650e53fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce647e4b-0e06-43e9-8817-6fc11917197b', 'volume_name': 'volume-ce647e4b-0e06-43e9-8817-6fc11917197b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15caf49d-89a5-4977-b1c2-5ac803a5aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15caf49d-89a5-4977-b1c2-5ac803a5aa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25fe75f-d249-4d02-813a-ec4466fb75fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Volume ce647e4b-0e06-43e9-8817-6fc11917197b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce647e4b-0e06-43e9-8817-6fc11917197b', 'volume_size': 1}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2019900362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce647e4b-0e06-43e9-8817-6fc11917197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ef95e65c564b759c7e36831dc22c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:17Z,use_quota=True,user_id='6a02c3ed9d684799abe0dcaa161369ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Creating volume ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:13:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:16 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b 1073741824
Sep 25 17:13:16 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:17 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b 1073741824" returned: 0 in 0.604s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:17 devstack sudo[101890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:13:17 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:17 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.353s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25fe75f-d249-4d02-813a-ec4466fb75fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce647e4b-0e06-43e9-8817-6fc11917197b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2008535d-e77e-4050-9a9b-888abb802fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Volume volume-ce647e4b-0e06-43e9-8817-6fc11917197b (ce647e4b-0e06-43e9-8817-6fc11917197b): created successfully
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2008535d-e77e-4050-9a9b-888abb802fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Flow 'volume_create_manager' (b7edea9b-6ae5-4d71-b27d-90cde6254e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-58666819-58d5-47f4-8b09-20627802e9eb tempest-TestStampPattern-138224678 None] Created volume successfully.
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (c07c9419-ab6b-404a-a41a-498b18c5b330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f03b0c-b771-42cb-bc7a-115da9982505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f03b0c-b771-42cb-bc7a-115da9982505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-210726145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9b47ba-97b1-472f-8abb-e9993bb3d85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:25Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b30e84e-6825-4d1f-8026-eeb67b12c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b30e84e-6825-4d1f-8026-eeb67b12c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85bf53-64f5-40fc-b1a8-4849e20debcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad85bf53-64f5-40fc-b1a8-4849e20debcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9b47ba-97b1-472f-8abb-e9993bb3d85d', 'volume_name': 'volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf5b09-f35b-4488-95a7-ecfa2a11b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf5b09-f35b-4488-95a7-ecfa2a11b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186920-250e-44d0-bb57-483f244ab9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Volume 5b9b47ba-97b1-472f-8abb-e9993bb3d85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d', 'volume_size': 1}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-210726145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9b47ba-97b1-472f-8abb-e9993bb3d85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e59223f5c4bbf9af19a98e870ef7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:25Z,use_quota=True,user_id='53e325b5ca264633bebed232f285d020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Creating volume 5b9b47ba-97b1-472f-8abb-e9993bb3d85d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:13:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:25 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d 1073741824
Sep 25 17:13:25 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:26 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d 1073741824" returned: 0 in 1.070s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:26 devstack sudo[102024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d
Sep 25 17:13:26 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:26 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7186920-250e-44d0-bb57-483f244ab9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22e6546-cbc1-4447-97ab-5199e657231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Volume volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d (5b9b47ba-97b1-472f-8abb-e9993bb3d85d): created successfully
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22e6546-cbc1-4447-97ab-5199e657231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Flow 'volume_create_manager' (c07c9419-ab6b-404a-a41a-498b18c5b330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-67ccf1ef-36ec-474f-9f0a-fd32636a4142 tempest-AttachVolumeNegativeTest-1419689403 None] Created volume successfully.
Sep 25 17:13:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-a17d690f-14aa-47f5-8bde-2244e03d14b0 req-54ab3c0d-1530-44cb-b19c-8a3a330ce6e3 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-a17d690f-14aa-47f5-8bde-2244e03d14b0 req-54ab3c0d-1530-44cb-b19c-8a3a330ce6e3 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-a17d690f-14aa-47f5-8bde-2244e03d14b0 req-54ab3c0d-1530-44cb-b19c-8a3a330ce6e3 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-a17d690f-14aa-47f5-8bde-2244e03d14b0 req-54ab3c0d-1530-44cb-b19c-8a3a330ce6e3 tempest-AttachVolumeNegativeTest-1419689403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd017c7c7-6c7f-4793-8efe-c5282404cdbe', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:13:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-a17d690f-14aa-47f5-8bde-2244e03d14b0 req-54ab3c0d-1530-44cb-b19c-8a3a330ce6e3 tempest-AttachVolumeNegativeTest-1419689403 None] attachment_update completed successfully.
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (2d9887b8-6198-4468-bcb5-c25b2707f27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b41d76-4ee4-4840-98eb-aa570a86b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b41d76-4ee4-4840-98eb-aa570a86b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2110678410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56366b5e-2336-4dd4-bb2c-9f07cfdf3793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:33Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7316785-78a8-40e0-ba10-a3b13ed9c0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7316785-78a8-40e0-ba10-a3b13ed9c0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db55dd1d-beb4-4e55-8c94-307ddd4b32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db55dd1d-beb4-4e55-8c94-307ddd4b32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56366b5e-2336-4dd4-bb2c-9f07cfdf3793', 'volume_name': 'volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2594e-df25-436d-9b13-1e4bfc7755a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c2594e-df25-436d-9b13-1e4bfc7755a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22b86a1-843b-4b3a-8d53-90a6173b81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Volume 56366b5e-2336-4dd4-bb2c-9f07cfdf3793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793', 'volume_size': 1}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2110678410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56366b5e-2336-4dd4-bb2c-9f07cfdf3793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:33Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Creating volume 56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:32 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:32 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 1073741824
Sep 25 17:13:32 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-658cfb18-b0db-455b-8dea-1cd14aad0d03 req-011639ee-a1cf-4183-a327-069f512a181d tempest-AttachVolumeNegativeTest-1419689403 None] Terminate volume connection completed successfully.
Sep 25 17:13:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-658cfb18-b0db-455b-8dea-1cd14aad0d03 req-011639ee-a1cf-4183-a327-069f512a181d tempest-AttachVolumeNegativeTest-1419689403 None] Deleting attachment d017c7c7-6c7f-4793-8efe-c5282404cdbe. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:13:33 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 1073741824" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:33 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793
Sep 25 17:13:33 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:34 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" returned: 0 in 0.569s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22b86a1-843b-4b3a-8d53-90a6173b81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42dceb3-f84b-45e9-a016-000246f1093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Volume volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 (56366b5e-2336-4dd4-bb2c-9f07cfdf3793): created successfully
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42dceb3-f84b-45e9-a016-000246f1093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (2d9887b8-6198-4468-bcb5-c25b2707f27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc3b3777-5f37-44c7-b9dc-74b541e438f9 tempest-VolumesSnapshotTestJSON-104412105 None] Created volume successfully.
Sep 25 17:13:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Creating offline snapshot 4e3186f6-2469-4d91-b98c-2a88f8072444 of volume 56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:13:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f953f3e-b525-4f75-b60d-398315830aa9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:36 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793
Sep 25 17:13:36 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:36 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" returned: 0 in 0.777s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:36 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 1G
Sep 25 17:13:36 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:36 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 1G" returned: 0 in 0.407s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:36 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444
Sep 25 17:13:36 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:37 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:37 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 is being set with open permissions: ugo+rw
Sep 25 17:13:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:37 devstack sudo[102179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444
Sep 25 17:13:37 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:37 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444" returned: 0 in 0.288s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:37 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info
Sep 25 17:13:37 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:38 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info" returned: 0 in 0.623s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:38 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info is being set with open permissions: ugo+rw
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:38 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info
Sep 25 17:13:38 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:38 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.info" returned: 0 in 0.314s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-08f38c36-5ddf-4533-9b51-0a6e87798389 tempest-VolumesSnapshotTestJSON-104412105 None] Create snapshot completed successfully
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-4e3186f6-2469-4d91-b98c-2a88f8072444-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-4e3186f6-2469-4d91-b98c-2a88f8072444-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-4e3186f6-2469-4d91-b98c-2a88f8072444" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-4e3186f6-2469-4d91-b98c-2a88f8072444" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Deleting offline snapshot 4e3186f6-2469-4d91-b98c-2a88f8072444 of volume 56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] snapshot_file for this snap is: volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859d9f9-4508-4093-9b0f-ef11c359e731]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:39 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444
Sep 25 17:13:39 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:39 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444" returned: 0 in 0.507s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e8eb3a-13f0-4e0a-99a2-ce50c40afb98]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:39 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793
Sep 25 17:13:39 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:40 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" returned: 0 in 0.436s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-5b9b47ba-97b1-472f-8abb-e9993bb3d85d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:40 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444
Sep 25 17:13:40 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-5b9b47ba-97b1-472f-8abb-e9993bb3d85d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-quobyte-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f79a1-9c74-40fc-ab9d-b071cd2f0fe6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:40 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d
Sep 25 17:13:40 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:40 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444" returned: 0 in 0.424s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:40 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444
Sep 25 17:13:40 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:40 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" returned: 0 in 0.406s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:40 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d
Sep 25 17:13:40 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:40 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793.4e3186f6-2469-4d91-b98c-2a88f8072444" returned: 0 in 0.291s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-4e3186f6-2469-4d91-b98c-2a88f8072444" released by "_delete_snapshot" :: held 1.804s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" released by "delete_snapshot" :: held 1.835s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:40 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['1aa454f9-f3b1-4412-9ec0-08c8109a3e86', '5bc0fb1e-91b2-417a-9c81-d263ba64a06b', 'bda4355e-984d-423d-a491-bf70771e0f9f', 'cdbe993e-c29f-4bea-a57c-78fb6226817f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-5b9b47ba-97b1-472f-8abb-e9993bb3d85d" released by "delete_volume" :: held 0.774s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Delete snapshot completed successfully.
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ce67c94e-8bc0-4216-bb41-b71f31fad43b tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-4e3186f6-2469-4d91-b98c-2a88f8072444-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Created reservations ['a7b22bd9-243e-4b06-ac7e-ba42b80867ad', '595d3fdf-20b1-4b31-8f19-f08ad10eb496', 'b250eeed-85f0-47d4-b694-1c996139e626', '9b7bd9fa-d5f2-4c74-8d12-a9753b37d212'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:41 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:41 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-9f8787bb-daa6-4001-b990-d2a31dd378dc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-9f8787bb-daa6-4001-b990-d2a31dd378dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:41 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-quobyte-9f8787bb-daa6-4001-b990-d2a31dd378dc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.442s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Deleted volume successfully.
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-9f8787bb-daa6-4001-b990-d2a31dd378dc" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-566414be-c658-46f3-83d5-595a2c517227 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-5b9b47ba-97b1-472f-8abb-e9993bb3d85d-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d94b6d-d3bd-4916-86be-a3c4808efed7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:41 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc
Sep 25 17:13:41 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (bbd89240-bfa0-4633-891d-a836aabbeb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5982ee-8f52-4838-9ce2-81a90423a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5982ee-8f52-4838-9ce2-81a90423a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1016955294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:42Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd3c993-bafd-4419-b5b7-f4e946b7e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd3c993-bafd-4419-b5b7-f4e946b7e465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff36b649-bbb0-44d1-a9c1-7bbe739fb8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff36b649-bbb0-44d1-a9c1-7bbe739fb8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2', 'volume_name': 'volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfb433e-c3b3-4312-918b-9cb05c8f93c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfb433e-c3b3-4312-918b-9cb05c8f93c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13028ca5-fe97-4c96-b5b4-0132588ffb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Volume 7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2', 'volume_size': 1}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1016955294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:42Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Creating volume 7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:41 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:13:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:41 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 1073741824
Sep 25 17:13:41 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:42 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:42 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc
Sep 25 17:13:42 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:42 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9f8787bb-daa6-4001-b990-d2a31dd378dc" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:42 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 1073741824" returned: 0 in 0.458s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-9f8787bb-daa6-4001-b990-d2a31dd378dc" released by "delete_volume" :: held 0.713s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:42 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:13:42 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Created reservations ['433af128-3750-45e1-9525-d31d564f7af8', '97c58961-7e0a-47ee-83ed-8af7cdb5a500', '58bd428f-5fc0-473f-803b-72b2abf06788', '856e88b4-4e29-47e0-8b06-c84ae339bccc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:42 devstack sudo[102257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:42 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:42 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13028ca5-fe97-4c96-b5b4-0132588ffb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2880a53a-b8b0-465b-aca0-6a859153620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Volume volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 (7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2): created successfully
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2880a53a-b8b0-465b-aca0-6a859153620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (bbd89240-bfa0-4633-891d-a836aabbeb56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7bbc553e-d97b-4e1c-9189-f7e6fa254b4e tempest-VolumesSnapshotTestJSON-104412105 None] Created volume successfully.
Sep 25 17:13:42 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Deleted volume successfully.
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-49a76367-f7bc-4415-b9a4-7a8e7a953e97 tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-9f8787bb-daa6-4001-b990-d2a31dd378dc-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "cinder-quobyte-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1954767-3078-48da-91ec-c8a52709ee4a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:43 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0
Sep 25 17:13:43 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:43 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:43 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0
Sep 25 17:13:43 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:43 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" returned: 0 in 0.278s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-quobyte-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0" released by "delete_volume" :: held 0.716s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Created reservations ['b2f6c6e7-f460-4d8f-a03f-f699f063cfbb', 'ad0cf995-e828-4531-ac2a-6ca6db1aae61', '2a0658fd-6529-4f15-a9ab-631e49987e66', 'e0c1614d-3742-4161-8f3e-3ecb8ee4a3d5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:43 devstack sudo[102270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:43 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Creating offline snapshot 808a0de9-6117-4291-8782-749117ef65ae of volume 7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:13:44 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d01343-f4dc-453f-aeb7-b5b6f2056233]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.365s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Deleted volume successfully.
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dba66e93-8be3-4a0e-89e4-b7b4bb6fea0a tempest-AttachVolumeNegativeTest-1419689403 None] Lock "cinder-e9b3cf63-5a6c-4eb9-9983-91ebfe8352b0-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:44 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:13:44 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:44 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.481s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:44 devstack sudo[102278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae 1G
Sep 25 17:13:44 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:45 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae 1G" returned: 0 in 0.591s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:45 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:13:45 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:45 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.352s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:45 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae is being set with open permissions: ugo+rw
Sep 25 17:13:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:45 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:13:45 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:45 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:46 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info
Sep 25 17:13:46 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:46 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info" returned: 0 in 0.308s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info is being set with open permissions: ugo+rw
Sep 25 17:13:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:46 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info
Sep 25 17:13:46 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:46 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.info" returned: 0 in 0.259s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-023a9130-1282-4268-b21d-e22da233cd8a tempest-VolumesSnapshotTestJSON-104412105 None] Create snapshot completed successfully
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (d6aa3642-0774-4944-b5d2-f648ae138f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe8499b-d71d-4cd6-ac75-b37fad676b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe8499b-d71d-4cd6-ac75-b37fad676b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1841918936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ebc26a-4650-4c2d-82a9-4167a681ef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=808a0de9-6117-4291-8782-749117ef65ae,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:48Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6288b31a-0d32-40e8-8d6d-54a94f6456b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6288b31a-0d32-40e8-8d6d-54a94f6456b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a3dd5-be87-4794-aef0-203ee1a68653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a3dd5-be87-4794-aef0-203ee1a68653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1ebc26a-4650-4c2d-82a9-4167a681ef59', 'volume_name': 'volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59', 'volume_size': 2, 'snapshot_id': '808a0de9-6117-4291-8782-749117ef65ae'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ee4335-aa1a-4576-8645-94576fc51aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ee4335-aa1a-4576-8645-94576fc51aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d58ca3-ab66-4bab-92c7-b5c34f5506aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Volume a1ebc26a-4650-4c2d-82a9-4167a681ef59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59', 'volume_size': 2, 'snapshot_id': '808a0de9-6117-4291-8782-749117ef65ae'}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae-a1ebc26a-4650-4c2d-82a9-4167a681ef59" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae-a1ebc26a-4650-4c2d-82a9-4167a681ef59" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Creating volume a1ebc26a-4650-4c2d-82a9-4167a681ef59 from snapshot 808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] snapshot: 808a0de9-6117-4291-8782-749117ef65ae, volume: a1ebc26a-4650-4c2d-82a9-4167a681ef59,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fde142-88ed-42bd-906e-333f1a3a7991]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:48 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:13:48 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:49 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8aeb19-8b5e-41e2-900e-ccb8591ab8dd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:49 devstack sudo[102312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:13:49 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:49 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.506s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:13:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:49 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59
Sep 25 17:13:49 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-53868cde-b499-4d06-a690-b3f1910dc303 req-2da8a19e-e799-4115-b4d8-ef81cb65be32 tempest-TestShelveInstance-1679220079 None] Terminate volume connection completed successfully.
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-53868cde-b499-4d06-a690-b3f1910dc303 req-2da8a19e-e799-4115-b4d8-ef81cb65be32 tempest-TestShelveInstance-1679220079 None] Deleting attachment 10b83971-4225-4277-a0eb-9447922fbb61. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Acquiring lock "cinder-b2f3ba07-798b-4d8d-9649-d79df9217108-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "cinder-b2f3ba07-798b-4d8d-9649-d79df9217108-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Acquiring lock "cinder-quobyte-b2f3ba07-798b-4d8d-9649-d79df9217108" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "cinder-quobyte-b2f3ba07-798b-4d8d-9649-d79df9217108" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee1380-48fd-4c90-97db-90aa5411197d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:13:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:53 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108
Sep 25 17:13:53 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e2849c4a-7573-418f-983f-141a77a1aaec req-20b151cb-7274-435d-8df2-a8ebe5b8ae49 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:53 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:53 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108
Sep 25 17:13:53 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:54 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2f3ba07-798b-4d8d-9649-d79df9217108" returned: 0 in 0.425s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "cinder-quobyte-b2f3ba07-798b-4d8d-9649-d79df9217108" released by "delete_volume" :: held 1.490s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG cinder.quota [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Created reservations ['c0e2960d-b146-46dd-8ff9-d0b5ebcdbebd', 'f3cc0be7-d5b9-40a6-8827-d899316b5c45', '2f4c2fa7-9f77-4376-8906-1499cada1286', '7a004248-899f-4a9b-979f-a98df4000ab8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:54 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:13:54 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:55 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.705s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:55 devstack cinder-volume[86955]: DEBUG cinder.manager [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:13:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Deleted volume successfully.
Sep 25 17:13:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-53868cde-b499-4d06-a690-b3f1910dc303 req-08a4f932-d61b-4a97-9365-6794ee8313d4 tempest-TestShelveInstance-1679220079 None] Lock "cinder-b2f3ba07-798b-4d8d-9649-d79df9217108-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Flow 'volume_create_manager' (c656208a-ddf6-4c7f-bb4a-d5399058d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e58d01-bb64-43ed-be7d-49433e240d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e58d01-bb64-43ed-be7d-49433e240d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-484046428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1ae48ec0f1c421eb0b7595d6aac2bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:59Z,use_quota=True,user_id='6a154a74dc3843958dbfcf1907ea601f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bd081f-2943-40f2-a76b-9ef3dded83db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bd081f-2943-40f2-a76b-9ef3dded83db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f80d91c-eedb-4bca-9608-9b1a14796409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f80d91c-eedb-4bca-9608-9b1a14796409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0', 'volume_name': 'volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1903261d-0fe7-441f-a3e5-a59cad633ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1903261d-0fe7-441f-a3e5-a59cad633ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee648891-d4d4-41d8-9c51-9b0f3e316e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Volume 7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0', 'volume_size': 1}
Sep 25 17:13:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:59 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59" returned: 0 in 9.416s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2, size 1024.00 MB, duration 9.42 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:13:59 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Converted 1024.00 MB image at 108.73 MB/s
Sep 25 17:13:59 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 is being set with open permissions: ugo+rw
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:59 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59
Sep 25 17:13:59 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:59 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59" returned: 0 in 0.287s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" released by "_copy_volume_from_snapshot" :: held 11.224s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae-a1ebc26a-4650-4c2d-82a9-4167a681ef59" released by "_create_volume_from_snapshot" :: held 11.304s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.319s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e2849c4a-7573-418f-983f-141a77a1aaec req-20b151cb-7274-435d-8df2-a8ebe5b8ae49 tempest-TestStampPattern-138224678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.089s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e2849c4a-7573-418f-983f-141a77a1aaec req-20b151cb-7274-435d-8df2-a8ebe5b8ae49 tempest-TestStampPattern-138224678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-484046428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1ae48ec0f1c421eb0b7595d6aac2bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:59Z,use_quota=True,user_id='6a154a74dc3843958dbfcf1907ea601f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Creating volume 7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:13:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:13:59 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 1073741824
Sep 25 17:13:59 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d58ca3-ab66-4bab-92c7-b5c34f5506aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59', 'volume_size': 2, 'snapshot_id': '808a0de9-6117-4291-8782-749117ef65ae'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37cc92f-14a0-4921-b354-dbc8e119b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:13:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Volume volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 (a1ebc26a-4650-4c2d-82a9-4167a681ef59): created successfully
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37cc92f-14a0-4921-b354-dbc8e119b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (d6aa3642-0774-4944-b5d2-f648ae138f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:13:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-e2849c4a-7573-418f-983f-141a77a1aaec req-20b151cb-7274-435d-8df2-a8ebe5b8ae49 tempest-TestStampPattern-138224678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-ce647e4b-0e06-43e9-8817-6fc11917197b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee4381fa-8091-4167-bdf3-f0356d2f0fa1', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:13:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5396f8d9-e635-49fb-9725-f27c2537ce04 tempest-VolumesSnapshotTestJSON-104412105 None] Created volume successfully.
Sep 25 17:13:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-e2849c4a-7573-418f-983f-141a77a1aaec req-20b151cb-7274-435d-8df2-a8ebe5b8ae49 tempest-TestStampPattern-138224678 None] attachment_update completed successfully.
Sep 25 17:14:00 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 1073741824" returned: 0 in 0.568s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:00 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0
Sep 25 17:14:00 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:00 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee648891-d4d4-41d8-9c51-9b0f3e316e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6090400-2f19-4841-845d-a8e1b9af2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Volume volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 (7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0): created successfully
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6090400-2f19-4841-845d-a8e1b9af2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Flow 'volume_create_manager' (c656208a-ddf6-4c7f-bb4a-d5399058d299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-74a2697e-3f98-46a9-95c9-3056d9f403f5 req-e6e4c032-68d0-41ec-8f2d-1c4debed76d7 tempest-VolumesGetTestJSON-237561510 None] Created volume successfully.
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-a1ebc26a-4650-4c2d-82a9-4167a681ef59-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-a1ebc26a-4650-4c2d-82a9-4167a681ef59-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c0e346-9114-40f5-bc76-de6211508e73]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:01 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59
Sep 25 17:14:01 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Acquiring lock "cinder-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "cinder-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:01 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Acquiring lock "cinder-quobyte-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59" returned: 0 in 0.513s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "cinder-quobyte-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:01 devstack sudo[102831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59
Sep 25 17:14:01 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d084e4-e156-4576-b9ff-efb7a5adbd4e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:01 devstack sudo[102833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0
Sep 25 17:14:01 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:01 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a1ebc26a-4650-4c2d-82a9-4167a681ef59" returned: 0 in 0.369s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-a1ebc26a-4650-4c2d-82a9-4167a681ef59" released by "delete_volume" :: held 0.967s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['068f9065-277d-4ee8-b8cb-4f622a93838b', 'a57c9220-2027-4224-887f-010bf45a43db', '667685e5-4333-45c5-8ca2-e36d9500597f', '05b778d2-cccd-4b0f-9f22-5036d7333020'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:02 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" returned: 0 in 0.584s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:02 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:02 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:02 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0
Sep 25 17:14:02 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:02 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:02 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.317s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "cinder-quobyte-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0" released by "delete_volume" :: held 0.931s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Deleted volume successfully.
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61e144d4-3a6a-484f-ad7f-1a8ac7d3a4b5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-a1ebc26a-4650-4c2d-82a9-4167a681ef59-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.quota [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Created reservations ['c12926cd-a775-4a79-ac67-0c223a393717', 'd0e3d207-51db-4a68-b5e6-b2cea66aa96d', '6f8d7f2d-d42a-46d2-a78f-e332747d7cef', 'e3a26c56-2784-426a-bdbc-789516626905'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:02 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:02 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:03 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.335s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.manager [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Deleted volume successfully.
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-0a58cf6c-5570-4d32-b191-11c59b9f53c9 req-32e77c01-8c09-4df8-816e-4341daf7009f tempest-VolumesGetTestJSON-237561510 None] Lock "cinder-7d90ecc5-ee91-46f6-83f1-3f6eb7ebcbd0-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-808a0de9-6117-4291-8782-749117ef65ae-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-808a0de9-6117-4291-8782-749117ef65ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Deleting offline snapshot 808a0de9-6117-4291-8782-749117ef65ae of volume 7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] snapshot_file for this snap is: volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c3fd90-3183-4015-b193-d5d6abf2a333]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:03 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:14:03 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:03 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:03 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:03 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:14:03 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.531s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:14:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cac0b3-46ea-4fa9-afbf-ec06f581d0a4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:04 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:14:04 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:04 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:04 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:14:04 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:05 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:05 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae
Sep 25 17:14:05 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:05 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2.808a0de9-6117-4291-8782-749117ef65ae" returned: 0 in 0.409s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-808a0de9-6117-4291-8782-749117ef65ae" released by "_delete_snapshot" :: held 2.261s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" released by "delete_snapshot" :: held 2.301s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['e6836803-6436-45a6-9e19-212b34ab1c25', '1b94692c-7978-4c4d-ac6c-f029d67d3223', 'd1578192-72ad-4fca-a35d-28999c2098a6', 'ae54f451-a447-4015-ba7b-8a4234025969'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Delete snapshot completed successfully.
Sep 25 17:14:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-069eaedf-4988-4fbf-9ae4-da5a681ecb50 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-808a0de9-6117-4291-8782-749117ef65ae-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-11c55c84-bc59-408c-ad7c-109624127852 req-fc5797f0-7d70-4a42-be73-69ea0ae403f2 tempest-TestStampPattern-138224678 None] Terminate volume connection completed successfully.
Sep 25 17:14:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-11c55c84-bc59-408c-ad7c-109624127852 req-fc5797f0-7d70-4a42-be73-69ea0ae403f2 tempest-TestStampPattern-138224678 None] Deleting attachment ee4381fa-8091-4167-bdf3-f0356d2f0fa1. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:14:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c10b5a-bf21-45ac-9a96-9f9ea067d2e5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Creating offline snapshot 668d0daa-f809-4ca0-88d0-15169662b506 of volume ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:14:07 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:14:07 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5ade5b-f799-4b0c-8bc4-545fb6458bd5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:07 devstack sudo[102920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:14:07 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:07 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.569s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:07 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2
Sep 25 17:14:07 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:07 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.525s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:07 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 1G
Sep 25 17:14:07 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:08 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" returned: 0 in 0.466s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2" released by "delete_volume" :: held 1.231s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['55aaea3f-6adc-47ec-b756-2d8b789c7b65', 'dceac237-13bb-43c0-a2a2-3db37580ad22', '8c43e0b2-0556-491a-bd84-52e1bcaef9ff', '7f395c88-234c-4cce-a885-d173daaa8035'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=83,cinder:INSERT=19,cinder:UPDATE=102,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=90,cinder:SELECT=105,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:08 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:08 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:08 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 1G" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce647e4b-0e06-43e9-8817-6fc11917197b -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:08 devstack sudo[102940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce647e4b-0e06-43e9-8817-6fc11917197b -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:14:08 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:08 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.429s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Deleted volume successfully.
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ecbf4ab-bfc5-4c94-8a06-fc5d2acbc90e tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-7c9e324b-7938-4b1c-a6db-cb4b9e4f26f2-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:08 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce647e4b-0e06-43e9-8817-6fc11917197b -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:08 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 is being set with open permissions: ugo+rw
Sep 25 17:14:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:09 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:14:09 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:09 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (f6872244-eb20-4949-9f7e-aa6117b52647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d570600b-ef98-4e9b-ad5b-b5a3eb76dd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d570600b-ef98-4e9b-ad5b-b5a3eb76dd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-579601873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f44dee-6e29-482e-b35a-e970c0f2d18a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:09Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2bdf43-3944-4d5f-813d-963845c5edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2bdf43-3944-4d5f-813d-963845c5edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ea1e42-1175-4afe-896c-0ed9b9ae659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ea1e42-1175-4afe-896c-0ed9b9ae659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f44dee-6e29-482e-b35a-e970c0f2d18a', 'volume_name': 'volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c742a336-2d20-428b-bc87-adf8e0634ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c742a336-2d20-428b-bc87-adf8e0634ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4adadd-b623-4b6c-8dcc-a6ceb0bae87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Volume d6f44dee-6e29-482e-b35a-e970c0f2d18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a', 'volume_size': 1}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:09 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info
Sep 25 17:14:09 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:09 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info" returned: 0 in 0.327s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:09 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info is being set with open permissions: ugo+rw
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:09 devstack sudo[102952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info
Sep 25 17:14:09 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (3fb2bc97-d9f0-44e6-ab8f-bd2b35a86b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b145559-7848-46c6-ab84-3c4233bec983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b145559-7848-46c6-ab84-3c4233bec983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-536111428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9369ee67-01a8-4d46-89fb-6233604106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:10Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cd4ab2-1bf2-42bb-a5bb-80cb4f163a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cd4ab2-1bf2-42bb-a5bb-80cb4f163a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3f1682-46d0-4a68-b372-cb3eac823338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3f1682-46d0-4a68-b372-cb3eac823338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9369ee67-01a8-4d46-89fb-6233604106e9', 'volume_name': 'volume-9369ee67-01a8-4d46-89fb-6233604106e9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0712294-5c8b-421c-871c-ff6cd7dff06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0712294-5c8b-421c-871c-ff6cd7dff06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbae1de-3a83-4f0e-90cb-64d062eba18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Volume 9369ee67-01a8-4d46-89fb-6233604106e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9369ee67-01a8-4d46-89fb-6233604106e9', 'volume_size': 1}
Sep 25 17:14:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:10 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.info" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-579601873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f44dee-6e29-482e-b35a-e970c0f2d18a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:09Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Creating volume d6f44dee-6e29-482e-b35a-e970c0f2d18a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:10 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:10 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a 1073741824
Sep 25 17:14:10 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7c5ed360-6928-4501-b888-618110470b79 tempest-TestStampPattern-138224678 None] Create snapshot completed successfully
Sep 25 17:14:10 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a 1073741824" returned: 0 in 0.599s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:11 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a
Sep 25 17:14:11 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:11 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-536111428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9369ee67-01a8-4d46-89fb-6233604106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:10Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Creating volume 9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:11 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4adadd-b623-4b6c-8dcc-a6ceb0bae87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:11 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 1073741824
Sep 25 17:14:11 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c18fa93-1ca1-45b9-b2dd-8f9db74a2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:11 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Volume volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a (d6f44dee-6e29-482e-b35a-e970c0f2d18a): created successfully
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c18fa93-1ca1-45b9-b2dd-8f9db74a2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (f6872244-eb20-4949-9f7e-aa6117b52647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-54a0e196-1d2f-4e9a-89f2-ca7a3ab27d46 tempest-VolumesTestJSON-750325038 None] Created volume successfully.
Sep 25 17:14:12 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 1073741824" returned: 0 in 0.678s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:12 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:12 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:12 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbae1de-3a83-4f0e-90cb-64d062eba18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9369ee67-01a8-4d46-89fb-6233604106e9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442abb63-c801-4fb3-8cf1-b73f09ad5c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Volume volume-9369ee67-01a8-4d46-89fb-6233604106e9 (9369ee67-01a8-4d46-89fb-6233604106e9): created successfully
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442abb63-c801-4fb3-8cf1-b73f09ad5c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (3fb2bc97-d9f0-44e6-ab8f-bd2b35a86b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fb1829fc-5cb7-47e7-897b-b128412a45d6 tempest-VolumesSnapshotTestJSON-104412105 None] Created volume successfully.
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (34c2f7e9-b5da-44f1-b874-361accdae40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38417de7-7c65-4a15-b93d-660368c2919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38417de7-7c65-4a15-b93d-660368c2919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1928583521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c197b680-bb81-4481-9724-1418ff687322,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:13Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b38325e-8e77-47c3-a96c-6f26498602a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b38325e-8e77-47c3-a96c-6f26498602a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2763eb8-e2cd-4b23-a6dc-08c7af8d762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2763eb8-e2cd-4b23-a6dc-08c7af8d762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c197b680-bb81-4481-9724-1418ff687322', 'volume_name': 'volume-c197b680-bb81-4481-9724-1418ff687322', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d8bde-52d9-4e73-be3d-077b3328f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d8bde-52d9-4e73-be3d-077b3328f65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ebc7a2-97bd-4843-8be6-3e6abb55e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Volume c197b680-bb81-4481-9724-1418ff687322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c197b680-bb81-4481-9724-1418ff687322', 'volume_size': 1}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1928583521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c197b680-bb81-4481-9724-1418ff687322,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:13Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Creating volume c197b680-bb81-4481-9724-1418ff687322 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:13 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 1073741824
Sep 25 17:14:13 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:14 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 1073741824" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:14 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322
Sep 25 17:14:14 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:14 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.113s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Creating offline snapshot 276fddf0-28d2-4411-bd83-a9cbd41e3c0b of volume 9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ebc7a2-97bd-4843-8be6-3e6abb55e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c197b680-bb81-4481-9724-1418ff687322', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d192fda-9fdb-40e1-86e2-505654924487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e8ad38-a449-42ce-9652-c9d92e2ee5c4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Volume volume-c197b680-bb81-4481-9724-1418ff687322 (c197b680-bb81-4481-9724-1418ff687322): created successfully
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d192fda-9fdb-40e1-86e2-505654924487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (34c2f7e9-b5da-44f1-b874-361accdae40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e8fd6254-5b98-4498-9a72-33cf76d19011 tempest-VolumesTestJSON-750325038 None] Created volume successfully.
Sep 25 17:14:14 devstack sudo[103015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:14 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:15 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 0.522s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:15 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b 1G
Sep 25 17:14:15 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:16 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b 1G" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369ee67-01a8-4d46-89fb-6233604106e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:16 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369ee67-01a8-4d46-89fb-6233604106e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:16 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (e92b274e-7b75-4380-8ea5-5fadec9fae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e171e3-2cd2-4d4d-b214-2e4d5eb64461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e171e3-2cd2-4d4d-b214-2e4d5eb64461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-147563186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d31840-8183-411e-8ba1-071e286dacd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:16Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a72596-85dc-4807-a287-e89f4c8a4a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a72596-85dc-4807-a287-e89f4c8a4a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20142ebb-10bf-4d5c-b002-eae0ac6a93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20142ebb-10bf-4d5c-b002-eae0ac6a93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d31840-8183-411e-8ba1-071e286dacd3', 'volume_name': 'volume-65d31840-8183-411e-8ba1-071e286dacd3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af173df5-dcf2-447b-be2c-4cb6005a0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af173df5-dcf2-447b-be2c-4cb6005a0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a289ec5-dd34-444a-9d82-5274184fc30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Volume 65d31840-8183-411e-8ba1-071e286dacd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d31840-8183-411e-8ba1-071e286dacd3', 'volume_size': 1}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:16 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9369ee67-01a8-4d46-89fb-6233604106e9 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 0.422s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:16 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b is being set with open permissions: ugo+rw
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:16 devstack sudo[103031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:16 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:16 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:16 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info
Sep 25 17:14:16 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:17 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:17 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info is being set with open permissions: ugo+rw
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:17 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info
Sep 25 17:14:17 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:17 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.info" returned: 0 in 0.278s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-147563186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d31840-8183-411e-8ba1-071e286dacd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d729f17dc184823ad6e4660887a11ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:16Z,use_quota=True,user_id='5fddba798efb4c6ba21433033f00f16d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Creating volume 65d31840-8183-411e-8ba1-071e286dacd3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:17 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:17 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 1073741824
Sep 25 17:14:17 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-343330f6-9b71-4614-8b98-2b5f568690e7 tempest-VolumesSnapshotTestJSON-104412105 None] Create snapshot completed successfully
Sep 25 17:14:18 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 1073741824" returned: 0 in 0.693s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:18 devstack sudo[103046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3
Sep 25 17:14:18 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:18 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3" returned: 0 in 0.317s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a289ec5-dd34-444a-9d82-5274184fc30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d31840-8183-411e-8ba1-071e286dacd3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fcc7e3-e182-4699-83c5-b437afa1a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Volume volume-65d31840-8183-411e-8ba1-071e286dacd3 (65d31840-8183-411e-8ba1-071e286dacd3): created successfully
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fcc7e3-e182-4699-83c5-b437afa1a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Flow 'volume_create_manager' (e92b274e-7b75-4380-8ea5-5fadec9fae91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-817f8754-8264-4fae-af81-1c0268b80526 tempest-VolumesTestJSON-750325038 None] Created volume successfully.
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (d3384976-9b8c-4933-a779-30f1504dbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc1c3e8-e2a5-4655-90d2-eae1598221c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc1c3e8-e2a5-4655-90d2-eae1598221c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1566490455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc1aafe-545b-4664-9b21-9e443b229554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d1cafadd9c44e65bf2013e547012104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=276fddf0-28d2-4411-bd83-a9cbd41e3c0b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:19Z,use_quota=True,user_id='a1c4c50ec7224177b0594a29d8b34ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dc4023-bc20-430a-82b2-84c1fe056f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dc4023-bc20-430a-82b2-84c1fe056f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4006427a-1dac-4a1e-a7eb-07971bd45db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4006427a-1dac-4a1e-a7eb-07971bd45db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dbc1aafe-545b-4664-9b21-9e443b229554', 'volume_name': 'volume-dbc1aafe-545b-4664-9b21-9e443b229554', 'volume_size': 1, 'snapshot_id': '276fddf0-28d2-4411-bd83-a9cbd41e3c0b'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f317cf-fb65-4517-9356-b2f6caa9af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f317cf-fb65-4517-9356-b2f6caa9af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04ab52d-4863-40f7-bcaa-77ec683a7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Volume dbc1aafe-545b-4664-9b21-9e443b229554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dbc1aafe-545b-4664-9b21-9e443b229554', 'volume_size': 1, 'snapshot_id': '276fddf0-28d2-4411-bd83-a9cbd41e3c0b'}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-dbc1aafe-545b-4664-9b21-9e443b229554" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-dbc1aafe-545b-4664-9b21-9e443b229554" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Creating volume dbc1aafe-545b-4664-9b21-9e443b229554 from snapshot 276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] snapshot: 276fddf0-28d2-4411-bd83-a9cbd41e3c0b, volume: dbc1aafe-545b-4664-9b21-9e443b229554,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bcb06a-56fa-40fc-98e4-6fe625b2438f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:20 devstack sudo[103054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:20 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Flow 'volume_create_manager' (ee3b1998-ac22-49ae-9149-2eb29caee98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40618ed6-6fd5-4474-a114-5aedbe49243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40618ed6-6fd5-4474-a114-5aedbe49243f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1061106967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb837f2-4223-47ca-88d9-881c2c6d13e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ef95e65c564b759c7e36831dc22c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=668d0daa-f809-4ca0-88d0-15169662b506,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:21Z,use_quota=True,user_id='6a02c3ed9d684799abe0dcaa161369ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3bf8ce9-7874-4fa5-b85b-bf671b59a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3bf8ce9-7874-4fa5-b85b-bf671b59a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e919ff-c4e1-4adf-8689-fc012aa26f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e919ff-c4e1-4adf-8689-fc012aa26f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ebb837f2-4223-47ca-88d9-881c2c6d13e6', 'volume_name': 'volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6', 'volume_size': 1, 'snapshot_id': '668d0daa-f809-4ca0-88d0-15169662b506'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187d6584-33fb-4163-b4e4-4de31aa038b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187d6584-33fb-4163-b4e4-4de31aa038b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8188fe5b-f47d-44b9-9802-1751200bde7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Volume ebb837f2-4223-47ca-88d9-881c2c6d13e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6', 'volume_size': 1, 'snapshot_id': '668d0daa-f809-4ca0-88d0-15169662b506'}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:20 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 0.898s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9369ee67-01a8-4d46-89fb-6233604106e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[00643272-03ac-4c03-a08b-1dde75d27e3f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:21 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:21 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-65d31840-8183-411e-8ba1-071e286dacd3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "cinder-65d31840-8183-411e-8ba1-071e286dacd3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-quobyte-65d31840-8183-411e-8ba1-071e286dacd3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-65d31840-8183-411e-8ba1-071e286dacd3" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[41406b33-0b5e-4f9c-8260-024426da3313]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:21 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3
Sep 25 17:14:21 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:21 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 0.705s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:21 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554
Sep 25 17:14:21 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:21 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3" returned: 0 in 0.561s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:22 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3
Sep 25 17:14:22 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:22 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65d31840-8183-411e-8ba1-071e286dacd3" returned: 0 in 0.408s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-65d31840-8183-411e-8ba1-071e286dacd3" released by "delete_volume" :: held 1.065s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Created reservations ['8dcbeb05-8196-4b21-a6e1-0a2056c27bde', 'c0f3ccfd-86a9-493c-bbeb-0d3c1ae10ee2', 'b4cc904b-fa58-47a4-8b17-e8a202d23530', 'fbe505fd-e1f9-4e12-8db5-31451ab8d8ed'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:22 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:22 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:23 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Deleted volume successfully.
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c6fc827-6638-4106-9c70-51a8016eb6f0 tempest-VolumesTestJSON-750325038 None] Lock "cinder-65d31840-8183-411e-8ba1-071e286dacd3-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-c197b680-bb81-4481-9724-1418ff687322-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "cinder-c197b680-bb81-4481-9724-1418ff687322-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-quobyte-c197b680-bb81-4481-9724-1418ff687322" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-c197b680-bb81-4481-9724-1418ff687322" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6f41c-6dc4-4ebd-bff7-1811780ed85e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:24 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322
Sep 25 17:14:24 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:24 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322" returned: 0 in 0.716s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:24 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322
Sep 25 17:14:24 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:25 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c197b680-bb81-4481-9724-1418ff687322" returned: 0 in 0.775s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-c197b680-bb81-4481-9724-1418ff687322" released by "delete_volume" :: held 1.639s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Created reservations ['eaf08776-4b90-406b-b0ff-7f1741e61a98', 'f7cd27a6-d2f0-4343-9982-e4483be3f41d', 'def33103-da75-4791-8c66-f05f67d704f9', 'f3c473bd-d160-425b-ae47-2ec223ee63c1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:26 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:26 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-d6f44dee-6e29-482e-b35a-e970c0f2d18a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "cinder-d6f44dee-6e29-482e-b35a-e970c0f2d18a-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Acquiring lock "cinder-quobyte-d6f44dee-6e29-482e-b35a-e970c0f2d18a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-d6f44dee-6e29-482e-b35a-e970c0f2d18a" acquired by "delete_volume" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:26 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.937s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:26 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Deleted volume successfully.
Sep 25 17:14:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e9714-5b1e-4ede-a502-e8dbaa7f0fd5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2076b979-413d-4fb8-91dd-4e0ea1687c3d tempest-VolumesTestJSON-750325038 None] Lock "cinder-c197b680-bb81-4481-9724-1418ff687322-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:27 devstack sudo[103106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a
Sep 25 17:14:27 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:28 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a" returned: 0 in 1.227s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:28 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a
Sep 25 17:14:28 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:29 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d6f44dee-6e29-482e-b35a-e970c0f2d18a" returned: 0 in 1.037s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "cinder-quobyte-d6f44dee-6e29-482e-b35a-e970c0f2d18a" released by "delete_volume" :: held 2.416s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Created reservations ['ffc0ea22-b31e-4a4b-a71d-8dbcf02aac1f', '8152d8e1-06f2-4ce0-802b-3e03e2299bff', '01ad5d93-ae0a-4055-ab7c-9c4300e641a3', 'aa804ca5-b316-40ac-888f-f7916e290d0e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:29 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:29 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:30 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.600s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:30 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Deleted volume successfully.
Sep 25 17:14:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b5ec13d-9e87-47ee-b790-a4e437714496 tempest-VolumesTestJSON-750325038 None] Lock "cinder-d6f44dee-6e29-482e-b35a-e970c0f2d18a-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:32 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554" returned: 0 in 10.914s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:32 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9, size 1024.00 MB, duration 10.92 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:14:32 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Converted 1024.00 MB image at 93.81 MB/s
Sep 25 17:14:32 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 is being set with open permissions: ugo+rw
Sep 25 17:14:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:32 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554
Sep 25 17:14:32 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:32 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554" returned: 0 in 0.374s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" released by "_copy_volume_from_snapshot" :: held 13.051s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-dbc1aafe-545b-4664-9b21-9e443b229554" released by "_create_volume_from_snapshot" :: held 13.194s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.243s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.156s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506-ebb837f2-4223-47ca-88d9-881c2c6d13e6" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506-ebb837f2-4223-47ca-88d9-881c2c6d13e6" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Creating volume ebb837f2-4223-47ca-88d9-881c2c6d13e6 from snapshot 668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04ab52d-4863-40f7-bcaa-77ec683a7c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc1aafe-545b-4664-9b21-9e443b229554', 'volume_size': 1, 'snapshot_id': '276fddf0-28d2-4411-bd83-a9cbd41e3c0b'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207ea18-c601-4a29-a49f-6a9e1240f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] snapshot: 668d0daa-f809-4ca0-88d0-15169662b506, volume: ebb837f2-4223-47ca-88d9-881c2c6d13e6,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:14:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Volume volume-dbc1aafe-545b-4664-9b21-9e443b229554 (dbc1aafe-545b-4664-9b21-9e443b229554): created successfully
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7207ea18-c601-4a29-a49f-6a9e1240f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Flow 'volume_create_manager' (d3384976-9b8c-4933-a779-30f1504dbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-04875c08-409a-454b-8e9e-90fb9b28dbee tempest-VolumesSnapshotTestJSON-104412105 None] Created volume successfully.
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4435e-abe9-47fd-93b3-341b810bd5e8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:33 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:14:33 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:33 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.554s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce647e4b-0e06-43e9-8817-6fc11917197b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bfc9f-8f6b-45d9-8ad0-2871d281c2ee]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:34 devstack sudo[103193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:14:34 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:34 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.510s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:34 devstack sudo[103202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6
Sep 25 17:14:34 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-dbc1aafe-545b-4664-9b21-9e443b229554-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-dbc1aafe-545b-4664-9b21-9e443b229554-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a8d30-74ff-41ce-9dd8-711f2f4e0867]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:35 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554
Sep 25 17:14:35 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:35 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554" returned: 0 in 0.672s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:35 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554
Sep 25 17:14:35 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:36 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dbc1aafe-545b-4664-9b21-9e443b229554" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-dbc1aafe-545b-4664-9b21-9e443b229554" released by "delete_volume" :: held 1.553s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['75dda66a-e3c0-461d-a0d4-6b994c2970c5', 'd0b8d9d3-a3ab-49d1-b083-a67dcaad54a0', '2ddb2dab-cd8f-4691-8fea-d173b9e08975', 'f5c068ef-6237-4fc4-9ef9-008ac2346c6d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:36 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:36 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Deleting offline snapshot 276fddf0-28d2-4411-bd83-a9cbd41e3c0b of volume 9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] snapshot_file for this snap is: volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4baad-5d39-498d-8bfc-e94425ed4227]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:37 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 1.218s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:37 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Deleted volume successfully.
Sep 25 17:14:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-368d9cf0-1de5-434f-9583-7fef8274bfb2 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-dbc1aafe-545b-4664-9b21-9e443b229554-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:38 devstack sudo[103278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:38 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:38 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 1.132s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9369ee67-01a8-4d46-89fb-6233604106e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:14:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd12fa-b0d9-4528-ba43-19f076f53c62]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:39 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:39 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:40 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 1.835s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:40 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:40 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:42 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 1.083s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:42 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b
Sep 25 17:14:42 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:42 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9.276fddf0-28d2-4411-bd83-a9cbd41e3c0b" returned: 0 in 0.879s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-276fddf0-28d2-4411-bd83-a9cbd41e3c0b" released by "_delete_snapshot" :: held 5.348s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" released by "delete_snapshot" :: held 5.446s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['5be181ef-811f-413a-9b73-e9ba4f9a7011', '9302186c-25c8-4812-b2c4-511eb8f17e3a', '5950b639-37c8-4133-9abd-fba5376b84a0', '8c63254c-7bbe-4bab-aea8-a93d4878de7e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Delete snapshot completed successfully.
Sep 25 17:14:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6c32d3b5-b5a2-4bec-b06a-96b9b4ad355a tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-276fddf0-28d2-4411-bd83-a9cbd41e3c0b-delete_snapshot" released by "delete_snapshot" :: held 6.081s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-9369ee67-01a8-4d46-89fb-6233604106e9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-9369ee67-01a8-4d46-89fb-6233604106e9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" acquired by "delete_volume" :: waited 0.060s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270184a-7c8a-400f-b06c-7fdd10a9614b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:45 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:45 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:46 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Flow 'volume_create_manager' (79ddca24-0756-4180-80a0-7dacb39be190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b050f91-712b-4049-8d4a-ade529813d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 1.460s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b050f91-712b-4049-8d4a-ade529813d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-410783245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bebb3a-e3d7-491e-87f5-2af374204f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad0f88fd44f409d9465663d67d5ef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:46Z,use_quota=True,user_id='028a97fd50c24227b1bfa395e766ad13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c8e276-19f1-4327-bc12-25a7fa1b6e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c8e276-19f1-4327-bc12-25a7fa1b6e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:46 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9
Sep 25 17:14:46 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06378338-ec46-48c5-b4e2-1ed17344b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06378338-ec46-48c5-b4e2-1ed17344b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bebb3a-e3d7-491e-87f5-2af374204f6d', 'volume_name': 'volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd8c82e-cba7-4dad-996f-17a789042e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd8c82e-cba7-4dad-996f-17a789042e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a249c29-1b3a-431c-aaf4-041682ad0707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume d4bebb3a-e3d7-491e-87f5-2af374204f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d', 'volume_size': 1}
Sep 25 17:14:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:47 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9369ee67-01a8-4d46-89fb-6233604106e9" returned: 0 in 0.696s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-9369ee67-01a8-4d46-89fb-6233604106e9" released by "delete_volume" :: held 2.364s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['7ca8b669-3633-4b15-a0cd-b2e3da83d1c9', '953ef4b8-6fd7-40fb-badc-dd5d9740797c', 'fedc7288-1a10-484a-950f-d0329cd5b828', '23cef130-5d5c-4d31-8de4-3225ee9ea13f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:47 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6" returned: 0 in 13.231s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b, size 1024.00 MB, duration 13.24 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:14:47 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Converted 1024.00 MB image at 77.36 MB/s
Sep 25 17:14:47 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 is being set with open permissions: ugo+rw
Sep 25 17:14:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:47 devstack sudo[103312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:47 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:47 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6
Sep 25 17:14:47 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:48 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.415s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Deleted volume successfully.
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-52546c7c-24ea-4349-b30c-ce8b798163f1 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-9369ee67-01a8-4d46-89fb-6233604106e9-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:48 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6" returned: 0 in 0.530s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" released by "_copy_volume_from_snapshot" :: held 15.040s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506-ebb837f2-4223-47ca-88d9-881c2c6d13e6" released by "_create_volume_from_snapshot" :: held 15.208s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.271s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-410783245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bebb3a-e3d7-491e-87f5-2af374204f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad0f88fd44f409d9465663d67d5ef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:46Z,use_quota=True,user_id='028a97fd50c24227b1bfa395e766ad13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Creating volume d4bebb3a-e3d7-491e-87f5-2af374204f6d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:48 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:48 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d 1073741824
Sep 25 17:14:48 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8188fe5b-f47d-44b9-9802-1751200bde7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6', 'volume_size': 1, 'snapshot_id': '668d0daa-f809-4ca0-88d0-15169662b506'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ef9751-d927-4258-8ec6-66e617f0de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Volume volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 (ebb837f2-4223-47ca-88d9-881c2c6d13e6): created successfully
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ef9751-d927-4258-8ec6-66e617f0de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Flow 'volume_create_manager' (ee3b1998-ac22-49ae-9149-2eb29caee98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa2c2196-18db-49cd-ae2b-fe69fd8732e9 tempest-TestStampPattern-138224678 None] Created volume successfully.
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-56366b5e-2336-4dd4-bb2c-9f07cfdf3793-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-56366b5e-2336-4dd4-bb2c-9f07cfdf3793-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a899e0-5e3b-4dbc-97f9-a567bd579867]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:49 devstack sudo[103324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793
Sep 25 17:14:49 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:49 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d 1073741824" returned: 0 in 0.960s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:49 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d
Sep 25 17:14:49 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:49 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:49 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793
Sep 25 17:14:49 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:49 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a249c29-1b3a-431c-aaf4-041682ad0707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f528aeb-241d-435a-8174-610354ee43aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d (d4bebb3a-e3d7-491e-87f5-2af374204f6d): created successfully
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f528aeb-241d-435a-8174-610354ee43aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Flow 'volume_create_manager' (79ddca24-0756-4180-80a0-7dacb39be190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4d3280ca-39f2-4494-891f-dadffc0cfb5c tempest-VolumeQuotasAdminTestJSON-1738904239 None] Created volume successfully.
Sep 25 17:14:50 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" returned: 0 in 0.485s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-quobyte-56366b5e-2336-4dd4-bb2c-9f07cfdf3793" released by "delete_volume" :: held 1.270s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Created reservations ['f5aebf80-b909-4be6-9f71-fda98ba348d0', '9393c169-77b8-4edd-92b0-10e1ef5c99ad', 'e01e69e5-5f81-4ea8-9657-ada2ed9a879e', '3025a5bc-44d6-421d-b5eb-160e02f56433'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:50 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:50 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:50 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "cinder-d4bebb3a-e3d7-491e-87f5-2af374204f6d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Deleted volume successfully.
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "cinder-d4bebb3a-e3d7-491e-87f5-2af374204f6d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ed89ad8b-4920-482c-98cc-f47518edf0a5 tempest-VolumesSnapshotTestJSON-104412105 None] Lock "cinder-56366b5e-2336-4dd4-bb2c-9f07cfdf3793-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "cinder-quobyte-d4bebb3a-e3d7-491e-87f5-2af374204f6d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "cinder-quobyte-d4bebb3a-e3d7-491e-87f5-2af374204f6d" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd448d-7391-44d7-aff7-551574778fed]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:51 devstack sudo[103346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d
Sep 25 17:14:51 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:51 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d" returned: 0 in 0.444s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:51 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d
Sep 25 17:14:51 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:51 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4bebb3a-e3d7-491e-87f5-2af374204f6d" returned: 0 in 0.282s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "cinder-quobyte-d4bebb3a-e3d7-491e-87f5-2af374204f6d" released by "delete_volume" :: held 0.793s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Created reservations ['a12ed59f-a5c0-4036-8af2-dc9ea3ef53e5', 'fcb07c26-65a0-4f4a-a3ab-65094b62a3ab', 'e470ff6c-3b63-4ce1-acdd-72d6cb531c78', '4252ba21-2c5f-45f2-81ae-dc0d75af594c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:51 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:51 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:52 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.338s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Deleted volume successfully.
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b6288c7f-bbf3-431e-a346-8035b97e4cb1 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "cinder-d4bebb3a-e3d7-491e-87f5-2af374204f6d-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Flow 'volume_create_manager' (9ca5a78a-4904-4cfe-87f1-ef6add06a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f54f77-3fb4-4453-bc5d-c994cdea7e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f54f77-3fb4-4453-bc5d-c994cdea7e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1667873136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b912d9-6bf5-41f8-84b3-5ad681354318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad0f88fd44f409d9465663d67d5ef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:53Z,use_quota=True,user_id='028a97fd50c24227b1bfa395e766ad13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a8d3bd-5461-46b8-b035-fe16077a1f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a8d3bd-5461-46b8-b035-fe16077a1f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a6ca2-1eeb-4999-9f2a-ca4cce18c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a6ca2-1eeb-4999-9f2a-ca4cce18c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b912d9-6bf5-41f8-84b3-5ad681354318', 'volume_name': 'volume-61b912d9-6bf5-41f8-84b3-5ad681354318', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5b1998-9c5f-4bf7-8c52-226df1aedc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5b1998-9c5f-4bf7-8c52-226df1aedc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655bb539-6d8c-44fe-82e2-032dd460cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:52 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume 61b912d9-6bf5-41f8-84b3-5ad681354318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b912d9-6bf5-41f8-84b3-5ad681354318', 'volume_size': 1}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1667873136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b912d9-6bf5-41f8-84b3-5ad681354318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad0f88fd44f409d9465663d67d5ef7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:53Z,use_quota=True,user_id='028a97fd50c24227b1bfa395e766ad13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Creating volume 61b912d9-6bf5-41f8-84b3-5ad681354318 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:52 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:52 devstack sudo[103357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 1073741824
Sep 25 17:14:52 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:53 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 1073741824" returned: 0 in 0.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:53 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318
Sep 25 17:14:53 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:53 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655bb539-6d8c-44fe-82e2-032dd460cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b912d9-6bf5-41f8-84b3-5ad681354318', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb437ed-85d2-492e-8fff-69e777cbd3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Volume volume-61b912d9-6bf5-41f8-84b3-5ad681354318 (61b912d9-6bf5-41f8-84b3-5ad681354318): created successfully
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb437ed-85d2-492e-8fff-69e777cbd3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Flow 'volume_create_manager' (9ca5a78a-4904-4cfe-87f1-ef6add06a72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-38f2ca8b-9e82-426e-b8f7-999b2d2cef55 tempest-VolumeQuotasAdminTestJSON-1738904239 None] Created volume successfully.
Sep 25 17:14:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fc1ce8a8-a492-469f-afc9-95b7ab74b465 tempest-VolumeQuotasAdminTestJSON-1807609843 None] Transfer volume completed successfully.
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Acquiring lock "cinder-61b912d9-6bf5-41f8-84b3-5ad681354318-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "cinder-61b912d9-6bf5-41f8-84b3-5ad681354318-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Acquiring lock "cinder-quobyte-61b912d9-6bf5-41f8-84b3-5ad681354318" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "cinder-quobyte-61b912d9-6bf5-41f8-84b3-5ad681354318" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d9b16-5441-4600-ae0c-1cc7884610ac]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:56 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318
Sep 25 17:14:56 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:56 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318" returned: 0 in 0.479s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:56 devstack sudo[103373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318
Sep 25 17:14:56 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:57 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-61b912d9-6bf5-41f8-84b3-5ad681354318" returned: 0 in 0.340s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "cinder-quobyte-61b912d9-6bf5-41f8-84b3-5ad681354318" released by "delete_volume" :: held 0.875s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Created reservations ['a7de0c4c-2856-4c6c-ba9f-f91334af4e6c', '350e5397-52e9-4f9d-a144-cb3475da415a', '64ec65b7-8cfd-4274-b997-0cf621eb771b', '4277bbbc-18cc-4fd5-b790-a5c9c94e9020'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:57 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:14:57 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:57 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.340s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:14:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Deleted volume successfully.
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f912509a-fb89-4834-aaee-6cb81eb25e62 tempest-VolumeQuotasAdminTestJSON-1977293623 None] Lock "cinder-61b912d9-6bf5-41f8-84b3-5ad681354318-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Flow 'volume_create_manager' (8de54548-9cdd-4dd4-95a6-98f03feec418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6a4326-09d8-484b-b362-6c4734c8c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6a4326-09d8-484b-b362-6c4734c8c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-203500950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccaca3f-e040-412b-9506-85ec98855e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560403e2c2e7487f914c0110b27fed92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:58Z,use_quota=True,user_id='875e027d21bb4f37b3d8fbe52eb8bf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38100039-66cf-4696-9e38-72ec3ab57fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38100039-66cf-4696-9e38-72ec3ab57fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1774da92-c785-4432-ab0f-30a5c1b43ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1774da92-c785-4432-ab0f-30a5c1b43ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccaca3f-e040-412b-9506-85ec98855e20', 'volume_name': 'volume-3ccaca3f-e040-412b-9506-85ec98855e20', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f91984-6438-4b90-9c5d-2dcfdf761afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f91984-6438-4b90-9c5d-2dcfdf761afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8e1b10-ce5e-42c5-b817-1c9fdffe2c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Volume 3ccaca3f-e040-412b-9506-85ec98855e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccaca3f-e040-412b-9506-85ec98855e20', 'volume_size': 1}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-203500950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccaca3f-e040-412b-9506-85ec98855e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560403e2c2e7487f914c0110b27fed92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:58Z,use_quota=True,user_id='875e027d21bb4f37b3d8fbe52eb8bf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Creating volume 3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:14:57 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:14:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:57 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 1073741824
Sep 25 17:14:57 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:58 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 1073741824" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:14:58 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:14:58 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:14:58 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8e1b10-ce5e-42c5-b817-1c9fdffe2c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccaca3f-e040-412b-9506-85ec98855e20', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7ae383-d292-4781-8f13-307072e4556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:14:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Volume volume-3ccaca3f-e040-412b-9506-85ec98855e20 (3ccaca3f-e040-412b-9506-85ec98855e20): created successfully
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7ae383-d292-4781-8f13-307072e4556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:14:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Flow 'volume_create_manager' (8de54548-9cdd-4dd4-95a6-98f03feec418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:14:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12adb281-f914-40b9-b6b7-16f618b3b3d5 tempest-TestImageHashVerification-1953658416 None] Created volume successfully.
Sep 25 17:15:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a1057-a629-4faf-94bc-75dc78fb4457]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:00 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:15:00 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:01 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.468s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd05a65-9ded-4b57-b9f5-89f52c7e8d2e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:01 devstack sudo[103394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:15:01 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:01 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 /opt/stack/data/cinder/conversion/3ccaca3f-e040-412b-9506-85ec98855e20.temp_image.12c36fb2-51bf-4782-9e59-714188994a18t3ech1a3.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:01 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 /opt/stack/data/cinder/conversion/3ccaca3f-e040-412b-9506-85ec98855e20.temp_image.12c36fb2-51bf-4782-9e59-714188994a18t3ech1a3.img
Sep 25 17:15:01 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (1b07786e-5fad-4c43-9707-4125493b1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857fe65a-2b9a-403e-b03b-7e74a86b5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857fe65a-2b9a-403e-b03b-7e74a86b5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392980264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ff4e33-5cc3-48bf-9832-40b5975dae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:02Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f0d7b6-8088-4e4b-8e7d-daf275ab1a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f0d7b6-8088-4e4b-8e7d-daf275ab1a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fad8880-54ff-4b24-bc39-ca3863902cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fad8880-54ff-4b24-bc39-ca3863902cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ff4e33-5cc3-48bf-9832-40b5975dae04', 'volume_name': 'volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628611c7-5362-4ce7-b655-ed1a98607d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628611c7-5362-4ce7-b655-ed1a98607d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29adbfe-9c32-492a-a25f-17ef5dcae23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume b2ff4e33-5cc3-48bf-9832-40b5975dae04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04', 'volume_size': 1}
Sep 25 17:15:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:03 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:03 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:04 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:15:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:15:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:15:09 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 /opt/stack/data/cinder/conversion/3ccaca3f-e040-412b-9506-85ec98855e20.temp_image.12c36fb2-51bf-4782-9e59-714188994a18t3ech1a3.img" returned: 0 in 8.200s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[118d342c-45d8-4c89-b7e3-8710839b3651]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=80,cinder:UPDATE=118,cinder:DELETE=5,cinder:INSERT=22 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=72,cinder:UPDATE=91,cinder:DELETE=15,cinder:INSERT=25 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Flow 'volume_create_manager' (b5518850-5965-475f-a4c8-2d4da56d14cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e1987c-c4e4-4b30-a73d-8e04b01e5fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e1987c-c4e4-4b30-a73d-8e04b01e5fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1048340253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21c20673be348138cee9eaa47b4edee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:10Z,use_quota=True,user_id='a047d46404ae48518676b6baf07b09cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c40de03-b8b5-4644-a7b2-a467d9f4d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c40de03-b8b5-4644-a7b2-a467d9f4d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5fb97a-e603-4e1b-b383-24d40465b560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:10 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:15:10 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5fb97a-e603-4e1b-b383-24d40465b560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f', 'volume_name': 'volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74d08c0-6878-4256-a3d1-6727cff07f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74d08c0-6878-4256-a3d1-6727cff07f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a96a9-0157-418e-8bb4-cef5606b1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Volume d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f', 'volume_size': 1}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe312d88-621a-41b5-93e6-e7602e376926 req-4efd137f-a7cd-4d6a-b4fe-8ddff0bfc491 tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:10 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.589s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/conversion/3ccaca3f-e040-412b-9506-85ec98855e20.temp_image.12c36fb2-51bf-4782-9e59-714188994a18t3ech1a3.img {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:15:10 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Converted 1024.00 MB image at 124.86 MB/s
Sep 25 17:15:10 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] 12c36fb2-51bf-4782-9e59-714188994a18 was raw, no need to convert to raw {{(pid=86955) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 17:15:20 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:15:20 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.682s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Uploaded volume to glance image-id: 12c36fb2-51bf-4782-9e59-714188994a18. {{(pid=86955) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.027s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392980264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ff4e33-5cc3-48bf-9832-40b5975dae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:02Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume b2ff4e33-5cc3-48bf-9832-40b5975dae04 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:30 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 1073741824
Sep 25 17:15:30 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1de8e413-dcaa-4705-9770-2c7a5514b4d5 tempest-TestImageHashVerification-1953658416 None] Copy volume to image completed successfully.
Sep 25 17:15:31 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 1073741824" returned: 0 in 0.525s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:31 devstack sudo[103463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04
Sep 25 17:15:31 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:31 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.224s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1048340253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21c20673be348138cee9eaa47b4edee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:10Z,use_quota=True,user_id='a047d46404ae48518676b6baf07b09cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Creating volume d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:31 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29adbfe-9c32-492a-a25f-17ef5dcae23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:31 devstack sudo[103466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f 1073741824
Sep 25 17:15:31 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae8114e-4938-45c5-a849-346823f8ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 (b2ff4e33-5cc3-48bf-9832-40b5975dae04): created successfully
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae8114e-4938-45c5-a849-346823f8ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (1b07786e-5fad-4c43-9707-4125493b1012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ce33cad2-e828-44a7-a834-e287df315769 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:31 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f 1073741824" returned: 0 in 0.523s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:31 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f
Sep 25 17:15:31 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Acquiring lock "cinder-3ccaca3f-e040-412b-9506-85ec98855e20-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "cinder-3ccaca3f-e040-412b-9506-85ec98855e20-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Acquiring lock "cinder-quobyte-3ccaca3f-e040-412b-9506-85ec98855e20" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "cinder-quobyte-3ccaca3f-e040-412b-9506-85ec98855e20" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e07527-c4b3-42fa-867d-206fdf5d3532]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (e554b49f-a23a-4b1f-81a0-0f8375dff9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc4c08-1726-41ea-ba63-ae8bd7a7db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc4c08-1726-41ea-ba63-ae8bd7a7db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900384756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9fdf9-9b4d-4a08-8b81-f490a56075e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84086b7-7d03-4b31-885e-dedc803a2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84086b7-7d03-4b31-885e-dedc803a2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5816fd7-43bf-4a7e-8ca9-068b3558c720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5816fd7-43bf-4a7e-8ca9-068b3558c720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee9fdf9-9b4d-4a08-8b81-f490a56075e4', 'volume_name': 'volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a0664f-3ef9-4448-9b56-24576dd33135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a0664f-3ef9-4448-9b56-24576dd33135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166e7650-707a-4b5e-a764-8bae64e6ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume aee9fdf9-9b4d-4a08-8b81-f490a56075e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4', 'volume_size': 1}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" returned: 0 in 0.382s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe312d88-621a-41b5-93e6-e7602e376926 req-4efd137f-a7cd-4d6a-b4fe-8ddff0bfc491 tempest-TestStampPattern-138224678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.874s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a96a9-0157-418e-8bb4-cef5606b1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db942e6b-7acb-4d00-bb25-f1d5abc5f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:32 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:15:32 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-fe312d88-621a-41b5-93e6-e7602e376926 req-4efd137f-a7cd-4d6a-b4fe-8ddff0bfc491 tempest-TestStampPattern-138224678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900384756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9fdf9-9b4d-4a08-8b81-f490a56075e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:32Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume aee9fdf9-9b4d-4a08-8b81-f490a56075e4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:32 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Volume volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f (d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f): created successfully
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db942e6b-7acb-4d00-bb25-f1d5abc5f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:32 devstack sudo[103477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 1073741824
Sep 25 17:15:32 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Flow 'volume_create_manager' (b5518850-5965-475f-a4c8-2d4da56d14cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c6bd92fd-8b4b-458a-9496-fb6796b6673a tempest-VolumesServicesTestJSON-495635741 None] Created volume successfully.
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-fe312d88-621a-41b5-93e6-e7602e376926 req-4efd137f-a7cd-4d6a-b4fe-8ddff0bfc491 tempest-TestStampPattern-138224678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7f190a9-80cd-4fc4-b20e-4f0e231d7c9b', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:15:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-fe312d88-621a-41b5-93e6-e7602e376926 req-4efd137f-a7cd-4d6a-b4fe-8ddff0bfc491 tempest-TestStampPattern-138224678 None] attachment_update completed successfully.
Sep 25 17:15:32 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.725s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:33 devstack sudo[103582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20
Sep 25 17:15:33 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Acquiring lock "cinder-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "cinder-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (85560c92-3d9f-478a-ab7a-1d213b349192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5536a1-b456-4272-9d65-58823c9691c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5536a1-b456-4272-9d65-58823c9691c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513831325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88501719-21d5-470f-8a06-2478ad7ce0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:33Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3549b3-fca8-45ac-9454-aef8a5080294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3549b3-fca8-45ac-9454-aef8a5080294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5b3b82-be85-4e80-b66d-e64ca4f71d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5b3b82-be85-4e80-b66d-e64ca4f71d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88501719-21d5-470f-8a06-2478ad7ce0e1', 'volume_name': 'volume-88501719-21d5-470f-8a06-2478ad7ce0e1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b042d6-8443-4c05-95e9-734c38671692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b042d6-8443-4c05-95e9-734c38671692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e727e647-e543-41c5-ad98-ded12b58f818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume 88501719-21d5-470f-8a06-2478ad7ce0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88501719-21d5-470f-8a06-2478ad7ce0e1', 'volume_size': 1}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:33 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 1073741824" returned: 0 in 1.017s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:33 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Acquiring lock "cinder-quobyte-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3ccaca3f-e040-412b-9506-85ec98855e20" returned: 0 in 0.513s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "cinder-quobyte-3ccaca3f-e040-412b-9506-85ec98855e20" released by "delete_volume" :: held 1.322s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "cinder-quobyte-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" acquired by "delete_volume" :: waited 0.061s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ded72-623b-4231-a2ae-b9f790018a4e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:33 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4
Sep 25 17:15:33 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Created reservations ['736adc65-5761-40a7-ae90-6cd6a10862ac', '35d38f63-3cef-4688-8404-57b1ec193170', '3573d4d3-12a2-4a76-8e91-d295abeb069d', '86f4bccd-596e-4934-bad0-1b2fdcd5fb3f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (77d0391e-8c48-442b-ad71-6c4f0a68979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecaf776-9320-4b97-b5c6-d01a8f82ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecaf776-9320-4b97-b5c6-d01a8f82ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220806222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774c5ef9-0ea5-4e6c-b892-15d9e3d70591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af79f88e-78e2-4e6c-99ab-c8038dc8731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af79f88e-78e2-4e6c-99ab-c8038dc8731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcb2317-1b36-41ec-a831-3193d1d5993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcb2317-1b36-41ec-a831-3193d1d5993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774c5ef9-0ea5-4e6c-b892-15d9e3d70591', 'volume_name': 'volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack sudo[103911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f
Sep 25 17:15:33 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5106b7fc-92b1-485e-8b64-6b88dd91fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5106b7fc-92b1-485e-8b64-6b88dd91fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3574a71-5416-494c-a251-a52103564003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume 774c5ef9-0ea5-4e6c-b892-15d9e3d70591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591', 'volume_size': 1}
Sep 25 17:15:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:34 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:34 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:34 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" returned: 0 in 0.641s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513831325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88501719-21d5-470f-8a06-2478ad7ce0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:33Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume 88501719-21d5-470f-8a06-2478ad7ce0e1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:34 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166e7650-707a-4b5e-a764-8bae64e6ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94629a7-e9c9-4b3b-b78b-10b04ddeef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 1073741824
Sep 25 17:15:34 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 (aee9fdf9-9b4d-4a08-8b81-f490a56075e4): created successfully
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94629a7-e9c9-4b3b-b78b-10b04ddeef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (e554b49f-a23a-4b1f-81a0-0f8375dff9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:34 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" returned: 0 in 0.858s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f52a0e05-2023-4d6f-a6da-96dfb3f864e6 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:34 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f
Sep 25 17:15:34 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:34 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.466s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Deleted volume successfully.
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (37b3a4ac-d2c6-463b-9b2d-45318ff4c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f452b5d-e217-4202-aa91-ed93a71eb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19e0a6d-b506-43ca-89e4-3f72cf27da9c tempest-TestImageHashVerification-1953658416 None] Lock "cinder-3ccaca3f-e040-412b-9506-85ec98855e20-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f452b5d-e217-4202-aa91-ed93a71eb301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586562767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fdaca3-cd14-4a76-8edc-037d03b3f115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c07af5-c099-4a23-8654-6d6e4bf050e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c07af5-c099-4a23-8654-6d6e4bf050e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164f6f54-cc46-4406-9d55-da43ad22cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164f6f54-cc46-4406-9d55-da43ad22cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fdaca3-cd14-4a76-8edc-037d03b3f115', 'volume_name': 'volume-65fdaca3-cd14-4a76-8edc-037d03b3f115', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51728e28-b026-44ec-ad96-8a93120590c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51728e28-b026-44ec-ad96-8a93120590c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4e9258-3e40-4680-9fc7-e7d208569e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume 65fdaca3-cd14-4a76-8edc-037d03b3f115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fdaca3-cd14-4a76-8edc-037d03b3f115', 'volume_size': 1}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:34 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" returned: 0 in 0.512s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "cinder-quobyte-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f" released by "delete_volume" :: held 1.455s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Created reservations ['4f77e1fa-9b06-4227-9bf4-a217fd62a386', 'ebba3af3-dc54-491b-941c-3cea49052010', '7995d970-7a87-4875-97fe-89362577afc0', '757068c4-7337-4971-bf58-59a7c6a42311'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:35 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 1073741824" returned: 0 in 0.917s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (8cfe1ff4-8688-461f-b63f-f7b07a833be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97819a99-51b4-47f3-9f83-a85b71c9340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97819a99-51b4-47f3-9f83-a85b71c9340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682465251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e154786-09b7-4374-8d4b-61ec2ef61759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:35Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9daaaf-8447-4b3d-8e87-139ccd849c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9daaaf-8447-4b3d-8e87-139ccd849c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c098b4c7-fbad-4b3d-8e85-96b73702fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c098b4c7-fbad-4b3d-8e85-96b73702fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e154786-09b7-4374-8d4b-61ec2ef61759', 'volume_name': 'volume-5e154786-09b7-4374-8d4b-61ec2ef61759', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2006ef-00b9-4c9d-ad1b-60b3923d3c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2006ef-00b9-4c9d-ad1b-60b3923d3c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40240d8-cad4-4167-8f25-2672a8698953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume 5e154786-09b7-4374-8d4b-61ec2ef61759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e154786-09b7-4374-8d4b-61ec2ef61759', 'volume_size': 1}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:35 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:35 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:35 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1
Sep 25 17:15:35 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:35 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Deleted volume successfully.
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2db7660f-dc29-4acd-b59d-a3c48148b070 tempest-VolumesServicesTestJSON-495635741 None] Lock "cinder-d87f5a1b-b9cf-4e44-b3f0-0e29d93f2f6f-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:35 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.994s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220806222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774c5ef9-0ea5-4e6c-b892-15d9e3d70591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume 774c5ef9-0ea5-4e6c-b892-15d9e3d70591 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:35 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:36 devstack sudo[103989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 1073741824
Sep 25 17:15:36 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e727e647-e543-41c5-ad98-ded12b58f818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88501719-21d5-470f-8a06-2478ad7ce0e1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267f137-4853-45df-9614-53e5bdf6e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-88501719-21d5-470f-8a06-2478ad7ce0e1 (88501719-21d5-470f-8a06-2478ad7ce0e1): created successfully
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a267f137-4853-45df-9614-53e5bdf6e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (85560c92-3d9f-478a-ab7a-1d213b349192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-04f126b5-f6f6-4816-8f01-167234020387 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:36 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 1073741824" returned: 0 in 0.634s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-a06b7bf9-b26e-4ada-8f26-2831a8b0a7e5 req-a4054107-8be8-4794-91ea-31f0188482eb tempest-TestStampPattern-138224678 None] Terminate volume connection completed successfully.
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-a06b7bf9-b26e-4ada-8f26-2831a8b0a7e5 req-a4054107-8be8-4794-91ea-31f0188482eb tempest-TestStampPattern-138224678 None] Deleting attachment c7f190a9-80cd-4fc4-b20e-4f0e231d7c9b. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:15:36 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591
Sep 25 17:15:36 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:36 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586562767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fdaca3-cd14-4a76-8edc-037d03b3f115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume 65fdaca3-cd14-4a76-8edc-037d03b3f115 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3574a71-5416-494c-a251-a52103564003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:37 devstack sudo[104030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 1073741824
Sep 25 17:15:37 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1204d6-ceb0-41f4-b630-6de7ef37e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 (774c5ef9-0ea5-4e6c-b892-15d9e3d70591): created successfully
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1204d6-ceb0-41f4-b630-6de7ef37e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (77d0391e-8c48-442b-ad71-6c4f0a68979a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-253f0494-c377-4b82-8363-f492530fb720 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:37 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 1073741824" returned: 0 in 0.579s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:37 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115
Sep 25 17:15:37 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:37 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682465251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e154786-09b7-4374-8d4b-61ec2ef61759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004e14e5b94643e29283a0c835754acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:35Z,use_quota=True,user_id='e639b80d8bb94a0db97952055843b130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Creating volume 5e154786-09b7-4374-8d4b-61ec2ef61759 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4e9258-3e40-4680-9fc7-e7d208569e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fdaca3-cd14-4a76-8edc-037d03b3f115', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:37 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 1073741824
Sep 25 17:15:37 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b87fa92-e594-499d-835a-b02d426df6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 (65fdaca3-cd14-4a76-8edc-037d03b3f115): created successfully
Sep 25 17:15:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b87fa92-e594-499d-835a-b02d426df6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (37b3a4ac-d2c6-463b-9b2d-45318ff4c539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-30ee4ff4-c99a-491d-b893-49e1001da417 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:38 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 1073741824" returned: 0 in 0.747s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:38 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759
Sep 25 17:15:38 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:39 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759" returned: 0 in 0.483s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40240d8-cad4-4167-8f25-2672a8698953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e154786-09b7-4374-8d4b-61ec2ef61759', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bdee2f-9c6b-4d94-84be-6f8eaac28265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Volume volume-5e154786-09b7-4374-8d4b-61ec2ef61759 (5e154786-09b7-4374-8d4b-61ec2ef61759): created successfully
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bdee2f-9c6b-4d94-84be-6f8eaac28265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Flow 'volume_create_manager' (8cfe1ff4-8688-461f-b63f-f7b07a833be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ecb910e7-4a2c-466d-9469-a01091467696 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created volume successfully.
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-5e154786-09b7-4374-8d4b-61ec2ef61759-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-5e154786-09b7-4374-8d4b-61ec2ef61759-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-5e154786-09b7-4374-8d4b-61ec2ef61759" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-5e154786-09b7-4374-8d4b-61ec2ef61759" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba83140-62d8-4f16-adbc-5e794384623b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:40 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759
Sep 25 17:15:40 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:40 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759" returned: 0 in 0.487s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:40 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759
Sep 25 17:15:40 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:40 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5e154786-09b7-4374-8d4b-61ec2ef61759" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-5e154786-09b7-4374-8d4b-61ec2ef61759" released by "delete_volume" :: held 0.847s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['88332664-a5dc-4adb-9504-c1a639735751', 'b23cb1ac-67d9-4319-83f0-eab0172b6159', '30313e07-5f2a-4662-b895-5f6f46ca2496', 'd8477510-82c8-4277-aa3c-b03773d479c1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:41 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:41 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-65fdaca3-cd14-4a76-8edc-037d03b3f115-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-65fdaca3-cd14-4a76-8edc-037d03b3f115-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-65fdaca3-cd14-4a76-8edc-037d03b3f115" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-65fdaca3-cd14-4a76-8edc-037d03b3f115" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d51ce3-100a-486a-947d-c2dda7fb9b69]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:41 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.474s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:41 devstack sudo[104089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115
Sep 25 17:15:41 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41f59426-7a71-4327-9fbe-63ee2e7b4dc5 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-5e154786-09b7-4374-8d4b-61ec2ef61759-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:41 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115" returned: 0 in 0.604s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:41 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115
Sep 25 17:15:41 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:42 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-65fdaca3-cd14-4a76-8edc-037d03b3f115" returned: 0 in 0.366s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-65fdaca3-cd14-4a76-8edc-037d03b3f115" released by "delete_volume" :: held 1.051s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['2096a918-a4c5-40a9-9dd1-2124c51f140c', '56f78671-a5e0-49b5-8324-21f2688c6ac5', '588d854f-1d82-4fd4-a0cb-a918c18de4d1', '0aa87144-47a6-4076-a9d3-7f045abfb698'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:42 devstack sudo[104100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:42 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:42 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.378s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-85f4c5f0-2c14-4f15-88f8-6bbe420e3e64 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-65fdaca3-cd14-4a76-8edc-037d03b3f115-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-774c5ef9-0ea5-4e6c-b892-15d9e3d70591-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-774c5ef9-0ea5-4e6c-b892-15d9e3d70591-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9148a-0a42-4b02-b289-869a1a443c7e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-ebb837f2-4223-47ca-88d9-881c2c6d13e6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "cinder-ebb837f2-4223-47ca-88d9-881c2c6d13e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:43 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591
Sep 25 17:15:43 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[742325d1-a2f7-402a-9618-9c244d038ddc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:43 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6
Sep 25 17:15:43 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:44 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" returned: 0 in 0.508s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:44 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591
Sep 25 17:15:44 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:44 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6" returned: 0 in 0.504s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:44 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6
Sep 25 17:15:44 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:44 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" returned: 0 in 0.326s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-774c5ef9-0ea5-4e6c-b892-15d9e3d70591" released by "delete_volume" :: held 0.915s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['2b9446d3-cf19-4846-bb40-0fdecab28958', 'd8c5edbe-6ce0-4d5a-afd6-e841ad730bba', '5fd99a59-c77c-4d49-822c-428a04801f2b', 'cec14a1c-91fa-4563-a6cd-0421737737e9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:44 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:44 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:44 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ebb837f2-4223-47ca-88d9-881c2c6d13e6" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ebb837f2-4223-47ca-88d9-881c2c6d13e6" released by "delete_volume" :: held 0.987s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-88501719-21d5-470f-8a06-2478ad7ce0e1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-88501719-21d5-470f-8a06-2478ad7ce0e1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-88501719-21d5-470f-8a06-2478ad7ce0e1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Created reservations ['d762c32b-9762-4f80-ba2e-fcfa39e06ae2', 'a4b02a32-452f-445d-b4ec-28ad37462c06', '404d93f6-780e-4292-9492-da70c1b668da', '19970525-3f43-482c-a8be-9d39fdae1e4b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-88501719-21d5-470f-8a06-2478ad7ce0e1" acquired by "delete_volume" :: waited 0.046s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea432e-01d7-4ff7-b91c-6b778d259c6e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:45 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:45 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:45 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:45 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1
Sep 25 17:15:45 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04dca592-43a2-4793-b45f-3f37bcb650e7 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-774c5ef9-0ea5-4e6c-b892-15d9e3d70591-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:45 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.350s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Deleted volume successfully.
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-720a810a-4836-4dfc-8cc0-987a59012a0b tempest-TestStampPattern-138224678 None] Lock "cinder-ebb837f2-4223-47ca-88d9-881c2c6d13e6-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:45 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1" returned: 0 in 0.509s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:45 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1
Sep 25 17:15:45 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:45 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-88501719-21d5-470f-8a06-2478ad7ce0e1" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-88501719-21d5-470f-8a06-2478ad7ce0e1" released by "delete_volume" :: held 0.850s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['12529e4b-2903-4efc-9358-2aa2ae9ecf0e', '6fefa021-1e7a-4d7b-8f32-d11161a49759', '1e5226d0-51d0-44cf-86f8-5fa735770226', '4f611ae4-bf96-4335-8e72-04d3f6d53e34'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:46 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:46 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-aee9fdf9-9b4d-4a08-8b81-f490a56075e4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-aee9fdf9-9b4d-4a08-8b81-f490a56075e4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c575685-f974-4e09-96a9-eb92e2b0a723]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-668d0daa-f809-4ca0-88d0-15169662b506-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-668d0daa-f809-4ca0-88d0-15169662b506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Deleting offline snapshot 668d0daa-f809-4ca0-88d0-15169662b506 of volume ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] snapshot_file for this snap is: volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:15:46 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.557s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[92032a8a-b43c-4941-9386-b3bad066ad53]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:46 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4
Sep 25 17:15:46 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6b5147d7-4717-481c-a969-4e1271348ce8 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-88501719-21d5-470f-8a06-2478ad7ce0e1-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:46 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:15:46 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:46 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:46 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4
Sep 25 17:15:46 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:47 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.449s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce647e4b-0e06-43e9-8817-6fc11917197b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f34ad-a04d-4be9-9892-6f5f7b243c30]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:47 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:47 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:15:47 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" returned: 0 in 0.336s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-aee9fdf9-9b4d-4a08-8b81-f490a56075e4" released by "delete_volume" :: held 0.890s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['b40bf42b-6202-442c-be08-8bc9887dd794', 'ea853f22-a076-43d6-be16-c5ee44a039a4', '1d425628-adaf-4826-992c-433d8fe64562', '3179b924-db8d-404d-9e5f-713b52af85f0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:47 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:47 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:47 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.694s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:47 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:15:47 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:47 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.345s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-37b190c6-a03e-4c1b-ba8d-8a0b2bf95f77 tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-aee9fdf9-9b4d-4a08-8b81-f490a56075e4-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:48 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.444s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:48 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506
Sep 25 17:15:48 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:48 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b.668d0daa-f809-4ca0-88d0-15169662b506" returned: 0 in 0.299s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-b2ff4e33-5cc3-48bf-9832-40b5975dae04-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-668d0daa-f809-4ca0-88d0-15169662b506" released by "_delete_snapshot" :: held 2.070s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-b2ff4e33-5cc3-48bf-9832-40b5975dae04-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" released by "delete_snapshot" :: held 2.118s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "cinder-quobyte-b2ff4e33-5cc3-48bf-9832-40b5975dae04" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-b2ff4e33-5cc3-48bf-9832-40b5975dae04" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2993a9e1-9641-432f-9da6-d75087068563]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Created reservations ['e925415b-8c2e-4c61-9dd2-7b2fac1da43e', 'b0691f37-4199-42fe-879e-17e770c3a855', '460e3ea7-2eaa-416f-8276-6e4a77184edb', '989a9847-2138-4d6c-a771-c93064d1d368'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Delete snapshot completed successfully.
Sep 25 17:15:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dbaa5cce-8120-459d-8969-99faa61aa8ae tempest-TestStampPattern-138224678 None] Lock "cinder-668d0daa-f809-4ca0-88d0-15169662b506-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:48 devstack sudo[104170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04
Sep 25 17:15:48 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:49 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04" returned: 0 in 0.464s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:49 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04
Sep 25 17:15:49 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:49 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b2ff4e33-5cc3-48bf-9832-40b5975dae04" returned: 0 in 0.288s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-quobyte-b2ff4e33-5cc3-48bf-9832-40b5975dae04" released by "delete_volume" :: held 0.810s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Created reservations ['e51a65c8-78ca-446b-8d86-eccf8fc5e489', 'b9b0ad8a-468a-4850-87f4-399a9295c121', '3f6b714f-3bf1-450f-8fd1-ab7fc7346027', 'b093d60d-ea59-42ff-8163-26a9037b536d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:49 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:49 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:50 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.391s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Deleted volume successfully.
Sep 25 17:15:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b855cb6-1cbe-42ec-84b3-277cac8e71ca tempest-CreateVolumesFromSourceVolumeTest-2065241575 None] Lock "cinder-b2ff4e33-5cc3-48bf-9832-40b5975dae04-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Flow 'volume_create_manager' (e5a3be73-41dd-4f39-b4ab-e00e57a6e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc729f62-0a78-4a5d-8212-062359647126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc729f62-0a78-4a5d-8212-062359647126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-433657367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeb822f-fa2c-4e70-8100-53cd528fe958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9e5b9b32f7492dbef03da5e36138b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:53Z,use_quota=True,user_id='adee67a2fe0447ce9c85adfb090dc444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76276195-159a-4db7-9195-0ec257a27270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76276195-159a-4db7-9195-0ec257a27270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4372e46c-3fda-4b41-9f1e-02b7a9392331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4372e46c-3fda-4b41-9f1e-02b7a9392331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eeb822f-fa2c-4e70-8100-53cd528fe958', 'volume_name': 'volume-0eeb822f-fa2c-4e70-8100-53cd528fe958', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e9028-99f3-403d-8f81-11354c54a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e9028-99f3-403d-8f81-11354c54a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590b4304-1293-4f5c-aaf8-26d9d350ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Volume 0eeb822f-fa2c-4e70-8100-53cd528fe958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eeb822f-fa2c-4e70-8100-53cd528fe958', 'volume_size': 1}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-433657367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeb822f-fa2c-4e70-8100-53cd528fe958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9e5b9b32f7492dbef03da5e36138b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:53Z,use_quota=True,user_id='adee67a2fe0447ce9c85adfb090dc444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Creating volume 0eeb822f-fa2c-4e70-8100-53cd528fe958 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:53 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:53 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 1073741824
Sep 25 17:15:53 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:53 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 1073741824" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:53 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958
Sep 25 17:15:53 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Flow 'volume_create_manager' (850c993f-8a79-4f31-a97a-e3cde7ef697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33965931-293a-4301-9128-bd5a591ce72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33965931-293a-4301-9128-bd5a591ce72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1453786667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b040367-3284-48b2-a056-156fe922a0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c95019fb1a04822bdb11a7b5523b50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:54Z,use_quota=True,user_id='36f744b7e5a44d12b3346bd01637ca73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba17cc4-1b92-44d4-872a-679a4eda2bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba17cc4-1b92-44d4-872a-679a4eda2bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2cc98d-bf4b-4807-9091-df6d6959af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2cc98d-bf4b-4807-9091-df6d6959af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b040367-3284-48b2-a056-156fe922a0f5', 'volume_name': 'volume-0b040367-3284-48b2-a056-156fe922a0f5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde87a22-0085-4a8d-a3a4-cafb3ef8322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde87a22-0085-4a8d-a3a4-cafb3ef8322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503593f1-36db-4523-9e9a-0e0baf1941a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Volume 0b040367-3284-48b2-a056-156fe922a0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b040367-3284-48b2-a056-156fe922a0f5', 'volume_size': 1}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:54 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958" returned: 0 in 0.307s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1453786667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b040367-3284-48b2-a056-156fe922a0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c95019fb1a04822bdb11a7b5523b50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:54Z,use_quota=True,user_id='36f744b7e5a44d12b3346bd01637ca73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Creating volume 0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:15:54 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590b4304-1293-4f5c-aaf8-26d9d350ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eeb822f-fa2c-4e70-8100-53cd528fe958', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 1073741824
Sep 25 17:15:54 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a9442a-bc8e-4819-9b17-7c64e4218818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Volume volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 (0eeb822f-fa2c-4e70-8100-53cd528fe958): created successfully
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a9442a-bc8e-4819-9b17-7c64e4218818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Flow 'volume_create_manager' (e5a3be73-41dd-4f39-b4ab-e00e57a6e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d973f353-0cf2-46ad-bc10-0f261d41ddbb tempest-VolumesTransfersV355Test-1295936481 None] Created volume successfully.
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-ce647e4b-0e06-43e9-8817-6fc11917197b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "cinder-ce647e4b-0e06-43e9-8817-6fc11917197b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Acquiring lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f5020-05b6-47f0-bcde-0effe54719e0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:54 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 1073741824" returned: 0 in 0.505s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:54 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:15:54 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:54 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:15:54 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:55 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.360s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503593f1-36db-4523-9e9a-0e0baf1941a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b040367-3284-48b2-a056-156fe922a0f5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b8cdb-bac6-43e3-89e0-b338c980e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Volume volume-0b040367-3284-48b2-a056-156fe922a0f5 (0b040367-3284-48b2-a056-156fe922a0f5): created successfully
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b8cdb-bac6-43e3-89e0-b338c980e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Flow 'volume_create_manager' (850c993f-8a79-4f31-a97a-e3cde7ef697f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:55 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.562s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e694a7a8-fbbe-4a0d-ab7d-7a2715490b3c tempest-VolumeDependencyTests-464561116 None] Created volume successfully.
Sep 25 17:15:55 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b
Sep 25 17:15:55 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:55 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ce647e4b-0e06-43e9-8817-6fc11917197b" returned: 0 in 0.288s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "cinder-quobyte-ce647e4b-0e06-43e9-8817-6fc11917197b" released by "delete_volume" :: held 0.949s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Created reservations ['9a629684-d19c-4c82-bd57-b3abf6c5c9d7', '037aa154-67d9-4c7f-b8f8-c2e49e139bfe', '673a4d35-9a84-4ca5-9d24-ae9c7bae568f', '4f031a39-31d6-41b7-aa91-5cb7ea5d9388'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:55 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:55 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:55 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.302s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Deleted volume successfully.
Sep 25 17:15:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9b3db03a-bd7a-4d6b-8e9a-3cff26970d04 tempest-VolumesTransfersV355Test-1391352633 None] Transfer volume completed successfully.
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f501222a-0588-4edf-a5c3-3fe9238dbd1b tempest-TestStampPattern-138224678 None] Lock "cinder-ce647e4b-0e06-43e9-8817-6fc11917197b-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Creating offline snapshot 602ea585-fc6f-4f66-abe2-211b3ab537be of volume 0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[69689bc3-ab22-4153-a75f-c596e2877ef4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:56 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:15:56 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:56 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "cinder-0eeb822f-fa2c-4e70-8100-53cd528fe958-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.432s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-0eeb822f-fa2c-4e70-8100-53cd528fe958-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:56 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be 1G
Sep 25 17:15:56 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "cinder-quobyte-0eeb822f-fa2c-4e70-8100-53cd528fe958" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:15:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-quobyte-0eeb822f-fa2c-4e70-8100-53cd528fe958" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c093e7fe-5f77-4c19-bee1-416c277d375a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:57 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958
Sep 25 17:15:57 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:57 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be 1G" returned: 0 in 0.585s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b040367-3284-48b2-a056-156fe922a0f5 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:57 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b040367-3284-48b2-a056-156fe922a0f5 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:15:57 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:57 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958" returned: 0 in 0.544s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:57 devstack sudo[104259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958
Sep 25 17:15:57 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:57 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b040367-3284-48b2-a056-156fe922a0f5 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:57 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be is being set with open permissions: ugo+rw
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:57 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:15:57 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:57 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0eeb822f-fa2c-4e70-8100-53cd528fe958" returned: 0 in 0.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-quobyte-0eeb822f-fa2c-4e70-8100-53cd528fe958" released by "delete_volume" :: held 0.949s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Created reservations ['397bc93e-a85c-420e-adcb-c62ca7e011a9', '20f15419-70cb-435e-bda6-45608ee05d31', '3fc1e421-80e3-48dc-999f-8db0c4f85f49', '43f93cf4-a8e8-417f-a435-c37042b185c4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:15:58 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.347s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:58 devstack sudo[104268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:58 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:58 devstack sudo[104270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info
Sep 25 17:15:58 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:58 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:15:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Deleted volume successfully.
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9ef9e9e-fb7f-47a5-ba1e-167a0d09c401 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-0eeb822f-fa2c-4e70-8100-53cd528fe958-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:15:58 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info" returned: 0 in 0.392s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info is being set with open permissions: ugo+rw
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:58 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info
Sep 25 17:15:58 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Flow 'volume_create_manager' (1c195f99-09c1-4ce3-9d3c-6d9d74c4feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5d02c5-a5ed-4d8c-8359-4b1f18b62c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5d02c5-a5ed-4d8c-8359-4b1f18b62c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd3cd0e-c388-41f7-b84b-d0ea742c0546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466dc742ba694f0e9d9eed5b505af751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:59Z,use_quota=True,user_id='3fb1406e52084d739226641cc21285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecf44ff-7331-4339-b5a3-8c354fdc2a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecf44ff-7331-4339-b5a3-8c354fdc2a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa21d0ee-a8d0-40ad-b64c-827e3ec87407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:15:58 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.info" returned: 0 in 0.261s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:15:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d4cc0544-8d11-402c-82dc-e08c3727d459 tempest-VolumeDependencyTests-464561116 None] Create snapshot completed successfully
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa21d0ee-a8d0-40ad-b64c-827e3ec87407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bd3cd0e-c388-41f7-b84b-d0ea742c0546', 'volume_name': 'volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546', 'volume_size': 1, 'image_id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b1fa9de23590ad0e2994c9435c80c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '466dc742ba694f0e9d9eed5b505af751', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492918eac2348fe302ca574d6e05cbd62576b6f938e9fcaa0a16cb244a4804ba35663cd90b9c979109959c4ff9da8902f438fdd3ad1b42b1c5ae25706bd6f13d', 'id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'created_at': datetime.datetime(2026, 9, 25, 15, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c6eeae-a499-430e-93a4-912a8d3540a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48b0c4ec0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f9ac9-68ec-4b16-974e-db6e6708d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f9ac9-68ec-4b16-974e-db6e6708d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06200c3-3636-45f0-bbf4-66b7e0d80c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:15:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546', 'volume_size': 1, 'image_id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b1fa9de23590ad0e2994c9435c80c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '466dc742ba694f0e9d9eed5b505af751', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492918eac2348fe302ca574d6e05cbd62576b6f938e9fcaa0a16cb244a4804ba35663cd90b9c979109959c4ff9da8902f438fdd3ad1b42b1c5ae25706bd6f13d', 'id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'created_at': datetime.datetime(2026, 9, 25, 15, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c6eeae-a499-430e-93a4-912a8d3540a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48b0c4ec0>}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Trying to clone 0bd3cd0e-c388-41f7-b84b-d0ea742c0546 from image 20c6eeae-a499-430e-93a4-912a8d3540a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:15:59 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eabb92-22d3-4829-a8e3-26a955ac8477]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:59 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:15:59 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:59 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:15:59 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:15:59 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Flow 'volume_create_manager' (c6550fd5-0d68-4899-9b32-d72ceb85060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:15:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99d5149-cd79-45ba-b86e-46442dc0ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99d5149-cd79-45ba-b86e-46442dc0ead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1632519013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4c03f7-3beb-423e-b38c-8ee43863e1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9e5b9b32f7492dbef03da5e36138b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:00Z,use_quota=True,user_id='adee67a2fe0447ce9c85adfb090dc444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc751ef8-af81-4e24-b1f9-ce87c69dccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc751ef8-af81-4e24-b1f9-ce87c69dccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adffd453-915a-4552-bf45-df2a1c835e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adffd453-915a-4552-bf45-df2a1c835e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4c03f7-3beb-423e-b38c-8ee43863e1eb', 'volume_name': 'volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a10616-a6b0-4392-86bc-b506f6367356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a10616-a6b0-4392-86bc-b506f6367356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013aa37a-caef-4b2a-9565-5a59f6192cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Volume 6a4c03f7-3beb-423e-b38c-8ee43863e1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb', 'volume_size': 1}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1632519013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4c03f7-3beb-423e-b38c-8ee43863e1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9e5b9b32f7492dbef03da5e36138b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:00Z,use_quota=True,user_id='adee67a2fe0447ce9c85adfb090dc444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Creating volume 6a4c03f7-3beb-423e-b38c-8ee43863e1eb {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:00 devstack sudo[104284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb 1073741824
Sep 25 17:16:00 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:00 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 1 in 0.500s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Temporary image 20c6eeae-a499-430e-93a4-912a8d3540a6 is fetched for user 3fb1406e52084d739226641cc21285cf. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Flow 'volume_create_manager' (b31ea493-80be-4ce4-9c02-eb452f5b26a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95146ad-eeb4-42bb-a422-57f595d482d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95146ad-eeb4-42bb-a422-57f595d482d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1937191794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3639aa67-8e9f-4cc2-b88b-93112f34c38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c95019fb1a04822bdb11a7b5523b50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=602ea585-fc6f-4f66-abe2-211b3ab537be,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:00Z,use_quota=True,user_id='36f744b7e5a44d12b3346bd01637ca73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15904536-52ea-4ed5-8507-e8459fa4b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15904536-52ea-4ed5-8507-e8459fa4b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd32911-bec7-4ae0-8a2a-82dcff871db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd32911-bec7-4ae0-8a2a-82dcff871db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3639aa67-8e9f-4cc2-b88b-93112f34c38d', 'volume_name': 'volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d', 'volume_size': 1, 'snapshot_id': '602ea585-fc6f-4f66-abe2-211b3ab537be'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d9f2a2-71c1-4360-9d88-f5c563e956ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d9f2a2-71c1-4360-9d88-f5c563e956ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c79a4f3-9e3b-474b-89a6-1817319ac842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Volume 3639aa67-8e9f-4cc2-b88b-93112f34c38d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d', 'volume_size': 1, 'snapshot_id': '602ea585-fc6f-4f66-abe2-211b3ab537be'}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1fa166-a621-4eb1-b60e-ffef2cbae2f8]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:00 devstack sudo[104292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:16:00 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:00 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb 1073741824" returned: 0 in 0.584s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:00 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb
Sep 25 17:16:00 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:00 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:00 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:16:00 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:01 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" returned: 0 in 0.291s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.528s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be-3639aa67-8e9f-4cc2-b88b-93112f34c38d" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013aa37a-caef-4b2a-9565-5a59f6192cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261983b7-687a-4670-b232-3cefff6ee768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be-3639aa67-8e9f-4cc2-b88b-93112f34c38d" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Creating volume 3639aa67-8e9f-4cc2-b88b-93112f34c38d from snapshot 602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Volume volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb (6a4c03f7-3beb-423e-b38c-8ee43863e1eb): created successfully
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261983b7-687a-4670-b232-3cefff6ee768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Flow 'volume_create_manager' (c6550fd5-0d68-4899-9b32-d72ceb85060c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] snapshot: 602ea585-fc6f-4f66-abe2-211b3ab537be, volume: 3639aa67-8e9f-4cc2-b88b-93112f34c38d,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:16:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-227a33c3-904e-4a5c-b8eb-0faf88b5eb94 tempest-VolumesTransfersV355Test-1295936481 None] Created volume successfully.
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67ab40-c8c5-4a1e-83dd-0088e8222ddc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:01 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:01 devstack sudo[104303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:16:01 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:01 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b040367-3284-48b2-a056-156fe922a0f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a33f21b-55f0-4ba1-ba52-a44bbe716181]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:01 devstack sudo[104311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:16:01 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:02 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.518s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:02 devstack sudo[104316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d
Sep 25 17:16:02 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "cinder-6a4c03f7-3beb-423e-b38c-8ee43863e1eb-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-6a4c03f7-3beb-423e-b38c-8ee43863e1eb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "cinder-quobyte-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-quobyte-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e707ca0-a24d-4af4-ac4b-87daae03ab4b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:02 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb
Sep 25 17:16:02 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:03 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:03 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb
Sep 25 17:16:03 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:03 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:03 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:03 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-quobyte-6a4c03f7-3beb-423e-b38c-8ee43863e1eb" released by "delete_volume" :: held 1.419s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:04 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.560s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Created reservations ['4b6f79ba-97c8-4830-9b95-e598d955b83d', '841824c5-77c3-45e1-a0df-bc86081c54ef', '774bc473-b054-47c6-94af-401d2da1cead', '94ad2b4d-dc2d-4132-bebb-cccaf597cbdc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:04 devstack sudo[104340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:04 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:04 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Deleted volume successfully.
Sep 25 17:16:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-47af0a77-a08c-4b43-8851-e2061ec6d187 tempest-VolumesTransfersV355Test-67496504 None] Lock "cinder-6a4c03f7-3beb-423e-b38c-8ee43863e1eb-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:10 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d" returned: 0 in 8.064s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:16:10 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Converted 1024.00 MB image at 126.97 MB/s
Sep 25 17:16:10 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d is being set with open permissions: ugo+rw
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:10 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d
Sep 25 17:16:10 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:10 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d" returned: 0 in 0.261s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" released by "_copy_volume_from_snapshot" :: held 9.354s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be-3639aa67-8e9f-4cc2-b88b-93112f34c38d" released by "_create_volume_from_snapshot" :: held 9.444s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.479s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.235s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd3cd0e-c388-41f7-b84b-d0ea742c0546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='466dc742ba694f0e9d9eed5b505af751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:59Z,use_quota=True,user_id='3fb1406e52084d739226641cc21285cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Creating volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:10 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:10 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1073741824
Sep 25 17:16:10 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c79a4f3-9e3b-474b-89a6-1817319ac842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d', 'volume_size': 1, 'snapshot_id': '602ea585-fc6f-4f66-abe2-211b3ab537be'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e31b50-a3e4-4778-9069-01bc3de9d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Volume volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d (3639aa67-8e9f-4cc2-b88b-93112f34c38d): created successfully
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e31b50-a3e4-4778-9069-01bc3de9d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Flow 'volume_create_manager' (b31ea493-80be-4ce4-9c02-eb452f5b26a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3487c2e2-e907-45f0-943b-119cb4b67a05 tempest-VolumeDependencyTests-464561116 None] Created volume successfully.
Sep 25 17:16:11 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1073741824" returned: 0 in 0.603s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:11 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546
Sep 25 17:16:11 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-602ea585-fc6f-4f66-abe2-211b3ab537be-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-602ea585-fc6f-4f66-abe2-211b3ab537be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Deleting offline snapshot 602ea585-fc6f-4f66-abe2-211b3ab537be of volume 0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] snapshot_file for this snap is: volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:16:11 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ea9b7-0f83-4e86-8809-71512c1eb629]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Attempting download of 20c6eeae-a499-430e-93a4-912a8d3540a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}])) to volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1072ad7-d9a4-48d2-8541-f08edd5ec732]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:11 devstack sudo[104362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:16:11 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:11 devstack sudo[104363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb
Sep 25 17:16:11 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:12 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.526s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b040367-3284-48b2-a056-156fe922a0f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d666af96-3466-4d9d-8130-727922d7f1c2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:12 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb" returned: 0 in 0.497s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:12 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:16:12 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:12 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb
Sep 25 17:16:12 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:12 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb" returned: 1 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c6eeae-a499-430e-93a4-912a8d3540a6_wilvufkb' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec6c18-4b57-4b9c-880d-a02a2bbfc4f3]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:12 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:16:12 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:12 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:12 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:16:12 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:12 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:13 devstack sudo[104386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD
Sep 25 17:16:13 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:13 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.452s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:13 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be
Sep 25 17:16:13 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:13 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] 20c6eeae-a499-430e-93a4-912a8d3540a6 was raw, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:13 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546
Sep 25 17:16:13 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:13 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5.602ea585-fc6f-4f66-abe2-211b3ab537be" returned: 0 in 0.320s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-602ea585-fc6f-4f66-abe2-211b3ab537be" released by "_delete_snapshot" :: held 2.195s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" released by "delete_snapshot" :: held 2.228s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Created reservations ['b2d682b6-abd4-4794-8ba9-c6e80cf17fa0', '1c9bc24b-aa0d-4c7c-8e8d-fd6f107fb624', 'aa588ccc-25ed-409f-969f-bec8ffd5c8ac', '1b101526-c01c-4cde-9b58-0cecd99411e9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Delete snapshot completed successfully.
Sep 25 17:16:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a00878aa-73aa-4b2c-b37b-08a3b39d88d6 tempest-VolumeDependencyTests-464561116 None] Lock "cinder-602ea585-fc6f-4f66-abe2-211b3ab537be-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:14 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" returned: 0 in 0.592s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20c6eeae-a499-430e-93a4-912a8d3540a6_yyr4fb06devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:16:14 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:14 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1G
Sep 25 17:16:14 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:14 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 1G" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Downloaded image 20c6eeae-a499-430e-93a4-912a8d3540a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}])) to volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Temporary image 20c6eeae-a499-430e-93a4-912a8d3540a6 for user 3fb1406e52084d739226641cc21285cf is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Marking volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Copying metadata from image 20c6eeae-a499-430e-93a4-912a8d3540a6 to 0bd3cd0e-c388-41f7-b84b-d0ea742c0546. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Creating volume glance metadata for volume 0bd3cd0e-c388-41f7-b84b-d0ea742c0546 backed by image 20c6eeae-a499-430e-93a4-912a8d3540a6 with: {'image_id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f4b1fa9de23590ad0e2994c9435c80c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06200c3-3636-45f0-bbf4-66b7e0d80c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546', 'volume_size': 1, 'image_id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c6eeae-a499-430e-93a4-912a8d3540a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b1fa9de23590ad0e2994c9435c80c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '466dc742ba694f0e9d9eed5b505af751', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '492918eac2348fe302ca574d6e05cbd62576b6f938e9fcaa0a16cb244a4804ba35663cd90b9c979109959c4ff9da8902f438fdd3ad1b42b1c5ae25706bd6f13d', 'id': '20c6eeae-a499-430e-93a4-912a8d3540a6', 'created_at': datetime.datetime(2026, 9, 25, 15, 15, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c6eeae-a499-430e-93a4-912a8d3540a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48b0c4ec0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcda6b19-f960-46b7-b8b7-f694f1049ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Volume volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 (0bd3cd0e-c388-41f7-b84b-d0ea742c0546): created successfully
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcda6b19-f960-46b7-b8b7-f694f1049ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Flow 'volume_create_manager' (1c195f99-09c1-4ce3-9d3c-6d9d74c4feec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-07ca072f-496c-4b0d-af55-2b9e28614ea8 tempest-VolumeImageDependencyTests-75464735 None] Created volume successfully.
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-0b040367-3284-48b2-a056-156fe922a0f5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "cinder-0b040367-3284-48b2-a056-156fe922a0f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d0c6c-3832-4ae3-9b35-532478d15bae]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:14 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:16:14 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:15 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.419s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:15 devstack sudo[104413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5
Sep 25 17:16:15 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Acquiring lock "cinder-0bd3cd0e-c388-41f7-b84b-d0ea742c0546-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "cinder-0bd3cd0e-c388-41f7-b84b-d0ea742c0546-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Acquiring lock "cinder-quobyte-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "cinder-quobyte-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33a160-cc84-4b6d-980f-fbf19d82a9ec]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:15 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b040367-3284-48b2-a056-156fe922a0f5" returned: 0 in 0.394s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-0b040367-3284-48b2-a056-156fe922a0f5" released by "delete_volume" :: held 0.896s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:15 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546
Sep 25 17:16:15 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Created reservations ['ae2aa7ce-bef5-4f35-92a0-a8ea5128b07c', '61a5752e-cf27-4a38-8075-8d01ad3ec8f5', 'd51bfa7a-f13c-496a-91b1-46aa15ac09ed', '96f99845-085f-4cf7-aa8e-f452185a690e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-3639aa67-8e9f-4cc2-b88b-93112f34c38d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:15 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:15 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "cinder-3639aa67-8e9f-4cc2-b88b-93112f34c38d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Acquiring lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:16 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" returned: 0 in 0.518s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9127e984-d1b9-416e-9084-aa0dff227e71]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:16 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546
Sep 25 17:16:16 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:16 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d
Sep 25 17:16:16 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:16 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.481s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Deleted volume successfully.
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e00a8e7e-e198-4f80-96ed-66406b34e4ca tempest-VolumeDependencyTests-464561116 None] Lock "cinder-0b040367-3284-48b2-a056-156fe922a0f5-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:16 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" returned: 0 in 0.456s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "cinder-quobyte-0bd3cd0e-c388-41f7-b84b-d0ea742c0546" released by "delete_volume" :: held 1.069s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:16 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d" returned: 0 in 0.543s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:16 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d
Sep 25 17:16:16 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Created reservations ['016c3ab0-077e-47be-8ebb-08ecc9c59033', '3fbc0730-c1a5-43ec-ba15-e87443c89ba6', '08a92012-9e4a-4404-aacb-5fe460b986aa', 'ef9bb9d9-c735-4303-9b99-e5985e2dac29'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:16 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:16 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:17 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3639aa67-8e9f-4cc2-b88b-93112f34c38d" returned: 0 in 0.422s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "cinder-quobyte-3639aa67-8e9f-4cc2-b88b-93112f34c38d" released by "delete_volume" :: held 1.058s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:17 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.304s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Deleted volume successfully.
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f26dd95c-fe44-4e34-8f6b-70e299ec6ece tempest-VolumeImageDependencyTests-75464735 None] Lock "cinder-0bd3cd0e-c388-41f7-b84b-d0ea742c0546-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Created reservations ['e83bb841-c8af-434c-a4c3-e9495a899141', 'ecb52b14-27e2-468f-9176-1b65e9a9fcad', '2794e292-8603-43f8-a0e1-6034b63e5a71', 'b4bd59a1-b410-4704-b0c7-5ebfd760bd40'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:17 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:17 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:17 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.280s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Deleted volume successfully.
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da96005d-4968-4b32-b5e9-4370096f5e9a tempest-VolumeDependencyTests-464561116 None] Lock "cinder-3639aa67-8e9f-4cc2-b88b-93112f34c38d-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Flow 'volume_create_manager' (af2be6c5-d28f-4ed0-9c16-c457d91d0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a1ebed-fb8f-404f-ad0b-f6ab9a4d65d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a1ebed-fb8f-404f-ad0b-f6ab9a4d65d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-353685816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ec386-9aaf-4fd0-adaf-7083a360ae9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316a332edad544c7930f5cc0fb99ce25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:18Z,use_quota=True,user_id='743c9051b59744849ef6a75f894b7d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29900616-582c-4ce5-82f5-91ce8291b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29900616-582c-4ce5-82f5-91ce8291b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f06fab-5314-4692-9c22-0b6af0aef4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f06fab-5314-4692-9c22-0b6af0aef4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83ec386-9aaf-4fd0-adaf-7083a360ae9d', 'volume_name': 'volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1bd29b-3f11-49d8-b2ec-1c2212883ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1bd29b-3f11-49d8-b2ec-1c2212883ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d442122-0122-416e-8a5c-57597b12a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Volume c83ec386-9aaf-4fd0-adaf-7083a360ae9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d', 'volume_size': 1}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-353685816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ec386-9aaf-4fd0-adaf-7083a360ae9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316a332edad544c7930f5cc0fb99ce25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:18Z,use_quota=True,user_id='743c9051b59744849ef6a75f894b7d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Creating volume c83ec386-9aaf-4fd0-adaf-7083a360ae9d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:18 devstack sudo[104441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d 1073741824
Sep 25 17:16:18 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:18 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d 1073741824" returned: 0 in 0.538s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:18 devstack sudo[104447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d
Sep 25 17:16:18 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:18 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" returned: 0 in 0.263s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d442122-0122-416e-8a5c-57597b12a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6c7b28-ff08-4e89-904b-d760a2bb9d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Volume volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d (c83ec386-9aaf-4fd0-adaf-7083a360ae9d): created successfully
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6c7b28-ff08-4e89-904b-d760a2bb9d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Flow 'volume_create_manager' (af2be6c5-d28f-4ed0-9c16-c457d91d0121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9aabe953-6602-4b31-bf24-9bcc5ff72e80 tempest-VolumesTransfersV357Test-2111626768 None] Created volume successfully.
Sep 25 17:16:21 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=135,cinder:UPDATE=176,cinder:DELETE=16,cinder:INSERT=42 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:16:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e67d2e8d-747b-40a1-825a-1ba9c5103e2f tempest-VolumesTransfersV357Test-585979368 None] Transfer volume completed successfully.
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "cinder-c83ec386-9aaf-4fd0-adaf-7083a360ae9d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-c83ec386-9aaf-4fd0-adaf-7083a360ae9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "cinder-quobyte-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-quobyte-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0e5662-0afe-4789-b8f2-bd6af98f2454]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:22 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d
Sep 25 17:16:22 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:23 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" returned: 0 in 0.562s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:23 devstack sudo[104458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d
Sep 25 17:16:23 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=173,cinder:SELECT=124,cinder:INSERT=49,cinder:DELETE=13 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Flow 'volume_create_manager' (a063a2b3-69c8-49ed-91fe-d184ffb815bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3e6c9-6ed7-46f4-b7a0-084f37d32c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3e6c9-6ed7-46f4-b7a0-084f37d32c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b28301-6d06-4fb0-a991-54605f46b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767991b18feb47a187a68daa10bc0e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:23Z,use_quota=True,user_id='7c5c57552428467caec52cb4e25ab3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8fa14d-6534-41c8-bdfb-63e5390a7516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8fa14d-6534-41c8-bdfb-63e5390a7516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57501835-9418-470b-bc37-1e226826ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57501835-9418-470b-bc37-1e226826ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b28301-6d06-4fb0-a991-54605f46b670', 'volume_name': 'volume-71b28301-6d06-4fb0-a991-54605f46b670', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a128f667-5edd-4779-af72-d96f89ca5de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a128f667-5edd-4779-af72-d96f89ca5de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2ab14-391d-43a7-9dbf-23398e5a0df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Volume 71b28301-6d06-4fb0-a991-54605f46b670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b28301-6d06-4fb0-a991-54605f46b670', 'volume_size': 1}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b28301-6d06-4fb0-a991-54605f46b670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767991b18feb47a187a68daa10bc0e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:23Z,use_quota=True,user_id='7c5c57552428467caec52cb4e25ab3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Creating volume 71b28301-6d06-4fb0-a991-54605f46b670 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:23 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 1073741824
Sep 25 17:16:23 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:23 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" returned: 0 in 0.389s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-quobyte-c83ec386-9aaf-4fd0-adaf-7083a360ae9d" released by "delete_volume" :: held 1.015s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Created reservations ['7196bcd1-97de-48ee-b622-b1e37ca2321f', 'd085603c-7236-4709-a778-db4427ab0210', 'e4e17124-c5f8-4170-a04c-847a183c9d77', '04c742c0-8cbb-483a-8271-86ee16708110'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:23 devstack sudo[104466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:23 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:24 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 1073741824" returned: 0 in 0.595s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:24 devstack sudo[104470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670
Sep 25 17:16:24 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:24 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.342s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Deleted volume successfully.
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdc6c427-95df-4e63-9bc1-4c5c06918c90 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-c83ec386-9aaf-4fd0-adaf-7083a360ae9d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:24 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a2ab14-391d-43a7-9dbf-23398e5a0df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b28301-6d06-4fb0-a991-54605f46b670', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14054ba7-16ab-48df-baf4-a415b84f7f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Volume volume-71b28301-6d06-4fb0-a991-54605f46b670 (71b28301-6d06-4fb0-a991-54605f46b670): created successfully
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14054ba7-16ab-48df-baf4-a415b84f7f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Flow 'volume_create_manager' (a063a2b3-69c8-49ed-91fe-d184ffb815bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-54aab2a3-c15b-46df-8110-bfde475f4c36 tempest-CinderUnicodeTest-1628367548 None] Created volume successfully.
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Flow 'volume_create_manager' (7350609d-d187-41c8-ba2e-4a9d61cc380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699a4a9-8895-45e6-a74e-3fbb0959f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699a4a9-8895-45e6-a74e-3fbb0959f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-826487531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0a0dfe-faea-4883-9138-21a99a8bf184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316a332edad544c7930f5cc0fb99ce25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:25Z,use_quota=True,user_id='743c9051b59744849ef6a75f894b7d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d84808-91d2-48a4-985b-54aee7d56bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d84808-91d2-48a4-985b-54aee7d56bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad23473c-392e-44e4-b79a-86ff7ca98503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad23473c-392e-44e4-b79a-86ff7ca98503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0a0dfe-faea-4883-9138-21a99a8bf184', 'volume_name': 'volume-ae0a0dfe-faea-4883-9138-21a99a8bf184', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f679e-3507-45de-add1-f953c911472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f679e-3507-45de-add1-f953c911472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360bcebd-775b-412c-b9c7-db8a727470c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Volume ae0a0dfe-faea-4883-9138-21a99a8bf184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0a0dfe-faea-4883-9138-21a99a8bf184', 'volume_size': 1}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-826487531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0a0dfe-faea-4883-9138-21a99a8bf184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316a332edad544c7930f5cc0fb99ce25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:25Z,use_quota=True,user_id='743c9051b59744849ef6a75f894b7d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Creating volume ae0a0dfe-faea-4883-9138-21a99a8bf184 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:25 devstack sudo[104473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 1073741824
Sep 25 17:16:25 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Flow 'volume_create_manager' (189be4f5-d5f3-4d02-ba7d-9c01d591d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4f3d41-31ec-4a33-9c40-8e51830a9f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4f3d41-31ec-4a33-9c40-8e51830a9f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1231345935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767991b18feb47a187a68daa10bc0e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:26Z,use_quota=True,user_id='7c5c57552428467caec52cb4e25ab3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cf338e-9c71-4776-9dfa-b816103f1c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cf338e-9c71-4776-9dfa-b816103f1c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c28672-71fe-4f67-b285-5625e9106f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c28672-71fe-4f67-b285-5625e9106f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31', 'volume_name': 'volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fafba9-2ea3-45c9-b5e1-6cac559becd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fafba9-2ea3-45c9-b5e1-6cac559becd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec6ec46-d8f0-4d97-8a44-0040f60cc654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Volume 76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31', 'volume_size': 1}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:26 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 1073741824" returned: 0 in 0.617s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:26 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184
Sep 25 17:16:26 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:26 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184" returned: 0 in 0.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1231345935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767991b18feb47a187a68daa10bc0e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:26Z,use_quota=True,user_id='7c5c57552428467caec52cb4e25ab3cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Creating volume 76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:26 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360bcebd-775b-412c-b9c7-db8a727470c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0a0dfe-faea-4883-9138-21a99a8bf184', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 1073741824
Sep 25 17:16:26 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d484e5d-f0ab-495f-b9ac-2fb207caebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Volume volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 (ae0a0dfe-faea-4883-9138-21a99a8bf184): created successfully
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d484e5d-f0ab-495f-b9ac-2fb207caebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Flow 'volume_create_manager' (7350609d-d187-41c8-ba2e-4a9d61cc380c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9ff71f11-0992-4dc4-b0a2-c7be6795803a tempest-VolumesTransfersV357Test-2111626768 None] Created volume successfully.
Sep 25 17:16:27 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 1073741824" returned: 0 in 0.605s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:27 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31
Sep 25 17:16:27 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:27 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" returned: 0 in 0.308s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec6ec46-d8f0-4d97-8a44-0040f60cc654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122f5440-700b-4031-905d-d06d9bae07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Volume volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 (76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31): created successfully
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122f5440-700b-4031-905d-d06d9bae07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Flow 'volume_create_manager' (189be4f5-d5f3-4d02-ba7d-9c01d591d199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-882e5061-b28b-4ac0-a957-e9c4be371172 tempest-CinderUnicodeTest-1628367548 None] Created volume successfully.
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "cinder-ae0a0dfe-faea-4883-9138-21a99a8bf184-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-ae0a0dfe-faea-4883-9138-21a99a8bf184-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "cinder-quobyte-ae0a0dfe-faea-4883-9138-21a99a8bf184" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-quobyte-ae0a0dfe-faea-4883-9138-21a99a8bf184" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[26664f1a-c459-4f16-838b-843df782b0b1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:28 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184
Sep 25 17:16:28 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Creating offline snapshot f3f801fc-1b10-4eb4-9907-861c401bdbf8 of volume 76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e19cc7-1052-4bad-b52e-f90de7d0284e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:28 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184" returned: 0 in 0.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:28 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184
Sep 25 17:16:28 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:28 devstack sudo[104495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31
Sep 25 17:16:28 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:28 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ae0a0dfe-faea-4883-9138-21a99a8bf184" returned: 0 in 0.270s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-quobyte-ae0a0dfe-faea-4883-9138-21a99a8bf184" released by "delete_volume" :: held 0.780s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Created reservations ['11be0a9d-c7c6-4510-aba6-fb43ecae632e', '8b57c7b2-bee1-4591-b1a7-946c9dd91b0f', '4936a973-5534-4db9-8145-d94494e75a6f', '2d9c8c72-2b03-43e9-82ad-68c83ee561b6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:28 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" returned: 0 in 0.467s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:29 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 1G
Sep 25 17:16:29 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:29 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:29 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:29 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.350s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Deleted volume successfully.
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-723fefdb-0d3a-4820-97e6-539350ff2f74 tempest-VolumesTransfersV357Test-1085778549 None] Lock "cinder-ae0a0dfe-faea-4883-9138-21a99a8bf184-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:29 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 1G" returned: 0 in 0.614s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:29 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8
Sep 25 17:16:29 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:29 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8" returned: 0 in 0.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:29 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 is being set with open permissions: ugo+rw
Sep 25 17:16:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:29 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8
Sep 25 17:16:29 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:30 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:30 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info
Sep 25 17:16:30 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:30 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info" returned: 0 in 0.301s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:30 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info is being set with open permissions: ugo+rw
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:30 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info
Sep 25 17:16:30 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:30 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.info" returned: 0 in 0.258s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-63280dcd-d28d-4ab7-8538-0052b177dbeb tempest-CinderUnicodeTest-1628367548 None] Create snapshot completed successfully
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-f3f801fc-1b10-4eb4-9907-861c401bdbf8-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-f3f801fc-1b10-4eb4-9907-861c401bdbf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-quobyte-f3f801fc-1b10-4eb4-9907-861c401bdbf8" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-f3f801fc-1b10-4eb4-9907-861c401bdbf8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Deleting offline snapshot f3f801fc-1b10-4eb4-9907-861c401bdbf8 of volume 76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] snapshot_file for this snap is: volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05c5213-f7b8-4c2c-95d5-3d64aa453324]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:31 devstack sudo[104528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8
Sep 25 17:16:31 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:32 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8" returned: 0 in 0.416s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[846dc19f-cbba-4a17-86e5-802962d8b6fb]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:32 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31
Sep 25 17:16:32 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:32 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" returned: 0 in 0.457s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:32 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8
Sep 25 17:16:32 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:33 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:33 devstack sudo[104546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8
Sep 25 17:16:33 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:33 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31.f3f801fc-1b10-4eb4-9907-861c401bdbf8" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-f3f801fc-1b10-4eb4-9907-861c401bdbf8" released by "_delete_snapshot" :: held 1.709s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" released by "delete_snapshot" :: held 1.733s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Created reservations ['12d8f209-f421-4a48-a0dc-b6f02e08366b', 'abc73200-12cf-4994-a9bb-90ba4fa730a3', '839de6e3-b999-495f-b16e-d85c981dbc57', '95e1ebbf-9073-4762-8b8b-af6bcb58062f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Delete snapshot completed successfully.
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-534f81a0-3e99-4229-aac6-84225b5555d9 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-f3f801fc-1b10-4eb4-9907-861c401bdbf8-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcfadf1-92ad-481d-92c1-d48514bbda70]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:34 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31
Sep 25 17:16:34 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:34 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" returned: 0 in 0.444s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:34 devstack sudo[104557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31
Sep 25 17:16:34 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:34 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" returned: 0 in 0.313s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31" released by "delete_volume" :: held 0.848s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Created reservations ['606a8482-9321-4cae-aa00-37b2fba41842', '92ca26e6-2f34-4108-85db-6264d9c354c8', 'e4b00e2c-2f05-4a8b-8631-c1d24b1a5c84', '94cf4dc9-73a0-4921-afb7-9e5ff2c9889a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:34 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:34 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-71b28301-6d06-4fb0-a991-54605f46b670-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-71b28301-6d06-4fb0-a991-54605f46b670-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "cinder-quobyte-71b28301-6d06-4fb0-a991-54605f46b670" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-71b28301-6d06-4fb0-a991-54605f46b670" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcf46c4-d1f3-4310-9f74-a51cf4e086bf]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:35 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Deleted volume successfully.
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2eabd6dd-c2b7-48be-9fa7-1ef2cb387236 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-76e5787f-87a1-4e2b-a18e-fc1ab9b2fe31-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:35 devstack sudo[104596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670
Sep 25 17:16:35 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:35 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670" returned: 0 in 0.527s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:35 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670
Sep 25 17:16:35 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:36 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71b28301-6d06-4fb0-a991-54605f46b670" returned: 0 in 0.317s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-quobyte-71b28301-6d06-4fb0-a991-54605f46b670" released by "delete_volume" :: held 0.908s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Created reservations ['22265402-9570-4141-acbd-e6c354960c4b', '5cb287af-6e9f-4fd6-b2ed-7615c74e33b0', '162b413f-b922-4bad-b909-e2e82d3cfb15', '8cf4c0e7-bebc-445f-9c4a-fe2d112a1d25'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:36 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:16:36 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:36 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.308s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:16:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Deleted volume successfully.
Sep 25 17:16:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0fc5558b-22d6-4fc8-b3e7-68e7befd9126 tempest-CinderUnicodeTest-1628367548 None] Lock "cinder-71b28301-6d06-4fb0-a991-54605f46b670-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Flow 'volume_create_manager' (f5e31503-de72-4ae4-979d-010e6c4a3ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d9a0b-fb6c-412f-a57f-4fe3c3feab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5d9a0b-fb6c-412f-a57f-4fe3c3feab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-265544508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc785d964e6d43f8b22f03a0e012da2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:46Z,use_quota=True,user_id='44136a7e89e24c6f931a492e50fa6612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad61d33-63a2-4322-b97a-e8f7a329cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad61d33-63a2-4322-b97a-e8f7a329cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f4a3b1-1531-42d0-9ce5-70b763c397f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f4a3b1-1531-42d0-9ce5-70b763c397f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9', 'volume_name': 'volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c5dbee-4b2b-4f92-a165-66fc2d576bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c5dbee-4b2b-4f92-a165-66fc2d576bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac50f04-0345-473e-bb4d-856c6481d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9', 'volume_size': 1}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-265544508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc785d964e6d43f8b22f03a0e012da2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:46Z,use_quota=True,user_id='44136a7e89e24c6f931a492e50fa6612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Creating volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:16:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:46 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 1073741824
Sep 25 17:16:46 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:46 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 1073741824" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:16:46 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:16:46 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:16:46 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac50f04-0345-473e-bb4d-856c6481d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b363ffa-eaf4-43b3-84ff-6a214afa31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:16:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Volume volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 (3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9): created successfully
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b363ffa-eaf4-43b3-84ff-6a214afa31e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:16:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Flow 'volume_create_manager' (f5e31503-de72-4ae4-979d-010e6c4a3ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:16:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0234b2c6-1b69-4209-82fb-ef688a7eb6d6 tempest-VolumesActionsTest-586383462 None] Created volume successfully.
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dfc1fe0d-7f92-438a-999f-7477d5e9bf74 tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dfc1fe0d-7f92-438a-999f-7477d5e9bf74 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" acquired by "attach_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dfc1fe0d-7f92-438a-999f-7477d5e9bf74 tempest-VolumesActionsTest-586383462 None] Attaching volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 to instance ea75d0df-549f-4f0d-afa5-217e00522e2d at mountpoint /dev/vdb on host None.
Sep 25 17:16:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dfc1fe0d-7f92-438a-999f-7477d5e9bf74 tempest-VolumesActionsTest-586383462 None] Attach volume completed successfully.
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dfc1fe0d-7f92-438a-999f-7477d5e9bf74 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" released by "attach_volume" :: held 0.087s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-638d6171-fe0b-4c0e-868c-aec50292e497 tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-638d6171-fe0b-4c0e-868c-aec50292e497 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:16:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-638d6171-fe0b-4c0e-868c-aec50292e497 tempest-VolumesActionsTest-586383462 None] Detaching volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 from instance ea75d0df-549f-4f0d-afa5-217e00522e2d.
Sep 25 17:16:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-638d6171-fe0b-4c0e-868c-aec50292e497 tempest-VolumesActionsTest-586383462 None] Detach volume completed successfully.
Sep 25 17:16:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-638d6171-fe0b-4c0e-868c-aec50292e497 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:03 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:17:03 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:03 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:17:04 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:17:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:17:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:17:05 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=50,cinder:DELETE=5 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:05 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=48,cinder:UPDATE=58,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8807fecd-4b08-47a1-a097-104f501dd36e tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:17:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8807fecd-4b08-47a1-a097-104f501dd36e tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" acquired by "attach_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:17:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8807fecd-4b08-47a1-a097-104f501dd36e tempest-VolumesActionsTest-586383462 None] Attaching volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 to instance 8dde7242-1866-47be-abef-bcecb0d5186c at mountpoint /dev/vdb on host None.
Sep 25 17:17:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8807fecd-4b08-47a1-a097-104f501dd36e tempest-VolumesActionsTest-586383462 None] Attach volume completed successfully.
Sep 25 17:17:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8807fecd-4b08-47a1-a097-104f501dd36e tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" released by "attach_volume" :: held 0.105s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:17:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-06690c14-c97f-4ce4-a05a-332234f1753a tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:17:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-06690c14-c97f-4ce4-a05a-332234f1753a tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:17:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-06690c14-c97f-4ce4-a05a-332234f1753a tempest-VolumesActionsTest-586383462 None] Detaching volume 3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 from instance 8dde7242-1866-47be-abef-bcecb0d5186c.
Sep 25 17:17:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-06690c14-c97f-4ce4-a05a-332234f1753a tempest-VolumesActionsTest-586383462 None] Detach volume completed successfully.
Sep 25 17:17:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-06690c14-c97f-4ce4-a05a-332234f1753a tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476c4c1-e1bd-4ccb-b05c-cc8780d69417]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:11 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:11 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:11 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.374s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7ef79-e7e0-48aa-97c9-42d0c1d52572]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:12 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:12 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:12 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.49508c1f-1962-4b72-8c74-ef2b1118fbcfmf50vkpf.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:12 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.49508c1f-1962-4b72-8c74-ef2b1118fbcfmf50vkpf.img
Sep 25 17:17:12 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:17 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:17 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.49508c1f-1962-4b72-8c74-ef2b1118fbcfmf50vkpf.img" returned: 0 in 5.199s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e9f87-36be-4a5b-96e4-38b48c2578c2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:17 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:17 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:18 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.521s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.49508c1f-1962-4b72-8c74-ef2b1118fbcfmf50vkpf.img {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:17:18 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Converted 1024.00 MB image at 196.92 MB/s
Sep 25 17:17:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] 49508c1f-1962-4b72-8c74-ef2b1118fbcf was raw, no need to convert to raw {{(pid=86955) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 17:17:28 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:28 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.956s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:17:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Uploaded volume to glance image-id: 49508c1f-1962-4b72-8c74-ef2b1118fbcf. {{(pid=86955) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 17:17:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3123732e-24b1-424e-835f-472e37b2683d tempest-VolumesActionsTest-586383462 None] Copy volume to image completed successfully.
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa591fac-2c15-4ae3-aeae-e804c3d78bc1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:38 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:38 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:38 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.376s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f3e7c-989a-4689-8290-d8c129e50a15]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:38 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:38 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:39 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:39 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img
Sep 25 17:17:39 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:44 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img" returned: 0 in 5.081s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5201d20-8d62-4178-9c16-06d9e192f32c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:44 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:44 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:44 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.510s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:17:44 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Converted 1024.00 MB image at 201.49 MB/s
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] 8d2df12e-3ef3-424c-8d8d-2a42df969e0b was raw, converting to qcow2 {{(pid=86955) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4919a1e-c3a6-427a-868e-960fcaa52503]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:44 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img
Sep 25 17:17:44 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:45 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img" returned: 0 in 0.322s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:45 devstack sudo[105004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img
Sep 25 17:17:45 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:45 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img" returned: 1 in 0.322s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:45 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8
Sep 25 17:17:45 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:45 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Image conversion details: src /opt/stack/data/cinder/conversion/3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9.temp_image.8d2df12e-3ef3-424c-8d8d-2a42df969e0b7z_c9ln5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:17:45 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9404853e-3760-4efc-b1aa-5c8a430762ff]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:45 devstack sudo[105015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8
Sep 25 17:17:45 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:45 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q3o1_l_8" returned: 0 in 0.316s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.936s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:17:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Uploaded volume to glance image-id: 8d2df12e-3ef3-424c-8d8d-2a42df969e0b. {{(pid=86955) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 17:17:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b9faa5f9-e120-445f-8165-3b9d1dfd6fb5 tempest-VolumesActionsTest-586383462 None] Copy volume to image completed successfully.
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Acquiring lock "cinder-quobyte-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "cinder-quobyte-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8da4f1c-d62b-4229-9d67-638aa6d2fcfa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:48 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:48 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:48 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.351s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:48 devstack sudo[105025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9
Sep 25 17:17:48 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:48 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" returned: 0 in 0.236s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "cinder-quobyte-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9" released by "delete_volume" :: held 0.628s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Created reservations ['265c09e3-c152-4a76-8992-bbe6011dc270', '7aaee315-6700-46b9-8789-43109450d7b2', 'd8ce38aa-2749-40a5-a43b-ccdbff5b8bed', '805b5395-13e5-451d-a24c-fbac34bcf206'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:17:49 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:17:49 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:17:49 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.228s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:17:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Deleted volume successfully.
Sep 25 17:17:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c01dd719-afa6-4fb6-9e51-0625126c1064 tempest-VolumesActionsTest-586383462 None] Lock "cinder-3d59bcbf-a1d6-4f4b-b644-e32665c9b1f9-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:17:59 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:17:59 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:03 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:18:03 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:03 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.265s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:18:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (20796194-33fe-4829-af94-f7365f37398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17af772f-201f-4bbb-8e6b-0dc16c42947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17af772f-201f-4bbb-8e6b-0dc16c42947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1543597359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855428f1-3da1-4e1f-8e72-9f1b48c3b1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:18Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(082e7b76-1d94-47fd-955f-e5e53f3f2e8b),volume_type_id=082e7b76-1d94-47fd-955f-e5e53f3f2e8b)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f7f258-3f57-43d3-89cf-37a07957c2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f7f258-3f57-43d3-89cf-37a07957c2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1446fd79-2f5f-43b3-b8e1-f936ba441d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1446fd79-2f5f-43b3-b8e1-f936ba441d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855428f1-3da1-4e1f-8e72-9f1b48c3b1fe', 'volume_name': 'volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea83e96-e333-4d21-ac32-280efbe62b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea83e96-e333-4d21-ac32-280efbe62b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91067947-cba2-4eb3-910a-1bd756aa673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume 855428f1-3da1-4e1f-8e72-9f1b48c3b1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe', 'volume_size': 1}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1543597359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855428f1-3da1-4e1f-8e72-9f1b48c3b1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:18Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(082e7b76-1d94-47fd-955f-e5e53f3f2e8b),volume_type_id=082e7b76-1d94-47fd-955f-e5e53f3f2e8b)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Creating volume 855428f1-3da1-4e1f-8e72-9f1b48c3b1fe {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:18 devstack sudo[105043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe 1073741824
Sep 25 17:18:18 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (3154cf21-5d6d-43c2-b324-28ed11fe211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2655a7-7dae-4511-8000-d5a558bcf4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2655a7-7dae-4511-8000-d5a558bcf4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-70835171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ac6f25-e2f1-4742-80d0-91d875067820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:18Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97f5cb75-6b29-478a-a5b6-63a638990d59),volume_type_id=97f5cb75-6b29-478a-a5b6-63a638990d59)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ae1c39-43be-439e-8543-e12b85d68db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ae1c39-43be-439e-8543-e12b85d68db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3bc251-af6a-47df-a82b-e2378cf21489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3bc251-af6a-47df-a82b-e2378cf21489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ac6f25-e2f1-4742-80d0-91d875067820', 'volume_name': 'volume-a6ac6f25-e2f1-4742-80d0-91d875067820', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea77f41-201a-406f-98e2-c1966cfb87b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea77f41-201a-406f-98e2-c1966cfb87b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc83110-2045-4e8a-a88b-27e4f096250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume a6ac6f25-e2f1-4742-80d0-91d875067820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ac6f25-e2f1-4742-80d0-91d875067820', 'volume_size': 1}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:18 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe 1073741824" returned: 0 in 0.519s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:18 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe
Sep 25 17:18:18 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:18 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-70835171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ac6f25-e2f1-4742-80d0-91d875067820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:18Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97f5cb75-6b29-478a-a5b6-63a638990d59),volume_type_id=97f5cb75-6b29-478a-a5b6-63a638990d59)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Creating volume a6ac6f25-e2f1-4742-80d0-91d875067820 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91067947-cba2-4eb3-910a-1bd756aa673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 1073741824
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a91eea-39a6-46f0-aed9-62fb5bd44a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:18 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe (855428f1-3da1-4e1f-8e72-9f1b48c3b1fe): created successfully
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a91eea-39a6-46f0-aed9-62fb5bd44a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (20796194-33fe-4829-af94-f7365f37398b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-68d04b4a-840b-4e16-aa7a-dfa1597b9399 tempest-TestInstancesWithCinderVolumes-1046896634 None] Created volume successfully.
Sep 25 17:18:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (ca021c54-7027-4cef-923c-188513dd2267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923d69be-b734-48bf-9706-0129b4c4385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923d69be-b734-48bf-9706-0129b4c4385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1083634244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6e5a01-cb49-4b47-acc8-f7c94cb92295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:19Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6d2f38-23e8-44b0-8294-eea60c2260f6),volume_type_id=bd6d2f38-23e8-44b0-8294-eea60c2260f6)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91bef9-9916-43f0-bb92-ac8adc305d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91bef9-9916-43f0-bb92-ac8adc305d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f330a2c-1d80-4974-9fbb-ef542eab85cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f330a2c-1d80-4974-9fbb-ef542eab85cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b6e5a01-cb49-4b47-acc8-f7c94cb92295', 'volume_name': 'volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295', 'volume_size': 1, 'image_id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2042345292', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f28f0286175c4a868644b57950816162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca466962-2d35-48c5-8292-81d35a6a26be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab25490>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e517a173-e34a-4886-9ffe-f5af300b95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e517a173-e34a-4886-9ffe-f5af300b95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7130389f-4881-4b62-82ae-3eb0bc4f5de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295', 'volume_size': 1, 'image_id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2042345292', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f28f0286175c4a868644b57950816162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca466962-2d35-48c5-8292-81d35a6a26be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab25490>}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Trying to clone 2b6e5a01-cb49-4b47-acc8-f7c94cb92295 from image ca466962-2d35-48c5-8292-81d35a6a26be at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:18:19 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 1073741824" returned: 0 in 0.533s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:19 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820
Sep 25 17:18:19 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:19 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc83110-2045-4e8a-a88b-27e4f096250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ac6f25-e2f1-4742-80d0-91d875067820', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db871c3a-8077-4775-b28f-2d9596bea84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume volume-a6ac6f25-e2f1-4742-80d0-91d875067820 (a6ac6f25-e2f1-4742-80d0-91d875067820): created successfully
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db871c3a-8077-4775-b28f-2d9596bea84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (3154cf21-5d6d-43c2-b324-28ed11fe211c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8094c093-73f8-48da-8baa-9aad95dd542d tempest-TestInstancesWithCinderVolumes-1046896634 None] Created volume successfully.
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD, size 20.69 MB, duration 2.82 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:18:22 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Image download 20.69 MB at 7.33 MB/s
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4c6cf-3942-47b0-bfaf-8b4f46d4dccc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:22 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD
Sep 25 17:18:22 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:22 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Temporary image ca466962-2d35-48c5-8292-81d35a6a26be is fetched for user a1c4f13767e648a8b7eb6e59f2e55265. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[23535924-0b54-45c5-ac62-184f37af5e4f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:18:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:22 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD
Sep 25 17:18:22 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:23 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1083634244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b6e5a01-cb49-4b47-acc8-f7c94cb92295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28f0286175c4a868644b57950816162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:19Z,use_quota=True,user_id='a1c4f13767e648a8b7eb6e59f2e55265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd6d2f38-23e8-44b0-8294-eea60c2260f6),volume_type_id=bd6d2f38-23e8-44b0-8294-eea60c2260f6)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Creating volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:18:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:23 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1073741824
Sep 25 17:18:23 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:23 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1073741824" returned: 0 in 0.460s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:23 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295
Sep 25 17:18:23 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:23 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" returned: 0 in 0.292s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Attempting download of ca466962-2d35-48c5-8292-81d35a6a26be ((None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}])) to volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[630df34a-1480-4508-b97a-4cc5d70efe03]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:18:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:24 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr
Sep 25 17:18:24 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:24 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr" returned: 0 in 0.348s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:24 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr
Sep 25 17:18:24 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:24 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr" returned: 1 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca466962-2d35-48c5-8292-81d35a6a26be_5l5xfrhr' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c674fc-eaae-4553-83ad-3792ef693fde]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:18:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:24 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD
Sep 25 17:18:24 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:25 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:25 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] ca466962-2d35-48c5-8292-81d35a6a26be was qcow2, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:18:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:25 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295
Sep 25 17:18:25 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:26 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" returned: 0 in 1.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:26 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca466962-2d35-48c5-8292-81d35a6a26be_bga80aaldevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:18:26 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Converted 112.00 MB image at 61.80 MB/s
Sep 25 17:18:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:18:26 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1G
Sep 25 17:18:26 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:18:27 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 1G" returned: 0 in 0.352s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Downloaded image ca466962-2d35-48c5-8292-81d35a6a26be ((None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}])) to volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Temporary image ca466962-2d35-48c5-8292-81d35a6a26be for user a1c4f13767e648a8b7eb6e59f2e55265 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Marking volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Copying metadata from image ca466962-2d35-48c5-8292-81d35a6a26be to 2b6e5a01-cb49-4b47-acc8-f7c94cb92295. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Creating volume glance metadata for volume 2b6e5a01-cb49-4b47-acc8-f7c94cb92295 backed by image ca466962-2d35-48c5-8292-81d35a6a26be with: {'image_id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'image_name': 'tempest-scenario-img--2042345292', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7130389f-4881-4b62-82ae-3eb0bc4f5de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295', 'volume_size': 1, 'image_id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca466962-2d35-48c5-8292-81d35a6a26be', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2042345292', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f28f0286175c4a868644b57950816162', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca466962-2d35-48c5-8292-81d35a6a26be', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca466962-2d35-48c5-8292-81d35a6a26be/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab25490>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843ad9ba-80d6-4b5c-b008-490a9f81cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:18:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Volume volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 (2b6e5a01-cb49-4b47-acc8-f7c94cb92295): created successfully
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843ad9ba-80d6-4b5c-b008-490a9f81cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:18:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Flow 'volume_create_manager' (ca021c54-7027-4cef-923c-188513dd2267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:18:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4246f854-7f68-4ded-858a-ec121f146cf7 tempest-TestInstancesWithCinderVolumes-1046896634 None] Created volume successfully.
Sep 25 17:18:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-9aa07708-8006-49fe-8fd3-0aa589fc86a5 req-35eba4da-9ee1-4a65-813b-706aea949b52 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:18:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-9aa07708-8006-49fe-8fd3-0aa589fc86a5 req-35eba4da-9ee1-4a65-813b-706aea949b52 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:18:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-9aa07708-8006-49fe-8fd3-0aa589fc86a5 req-35eba4da-9ee1-4a65-813b-706aea949b52 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:18:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-9aa07708-8006-49fe-8fd3-0aa589fc86a5 req-35eba4da-9ee1-4a65-813b-706aea949b52 tempest-TestInstancesWithCinderVolumes-1046896634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b114fe07-9cf3-40f5-86eb-6c02f2f3e253', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:18:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-9aa07708-8006-49fe-8fd3-0aa589fc86a5 req-35eba4da-9ee1-4a65-813b-706aea949b52 tempest-TestInstancesWithCinderVolumes-1046896634 None] attachment_update completed successfully.
Sep 25 17:18:40 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:18:40 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:19:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26929227-aeac-4fd7-b7a0-d385598b836b req-4bf6c993-2009-47b3-aa9f-730615b5f7e0 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26929227-aeac-4fd7-b7a0-d385598b836b req-4bf6c993-2009-47b3-aa9f-730615b5f7e0 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26929227-aeac-4fd7-b7a0-d385598b836b req-4bf6c993-2009-47b3-aa9f-730615b5f7e0 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-26929227-aeac-4fd7-b7a0-d385598b836b req-4bf6c993-2009-47b3-aa9f-730615b5f7e0 tempest-TestInstancesWithCinderVolumes-1046896634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9bd8f85-a1ba-43a1-8d4c-ce12a3cd0543', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:19:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-26929227-aeac-4fd7-b7a0-d385598b836b req-4bf6c993-2009-47b3-aa9f-730615b5f7e0 tempest-TestInstancesWithCinderVolumes-1046896634 None] attachment_update completed successfully.
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:03 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:03 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:03 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:19:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:19:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-5a01f03a-ec50-48d1-bbd9-ff1325b78d84 req-f0be6de0-683c-4c52-b9d1-f67e30e58c88 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-5a01f03a-ec50-48d1-bbd9-ff1325b78d84 req-f0be6de0-683c-4c52-b9d1-f67e30e58c88 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-5a01f03a-ec50-48d1-bbd9-ff1325b78d84 req-f0be6de0-683c-4c52-b9d1-f67e30e58c88 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-5a01f03a-ec50-48d1-bbd9-ff1325b78d84 req-f0be6de0-683c-4c52-b9d1-f67e30e58c88 tempest-TestInstancesWithCinderVolumes-1046896634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0', 'name': 'volume-a6ac6f25-e2f1-4742-80d0-91d875067820', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97ba8979-250d-49cb-bf90-735512c3699e', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 17:19:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-5a01f03a-ec50-48d1-bbd9-ff1325b78d84 req-f0be6de0-683c-4c52-b9d1-f67e30e58c88 tempest-TestInstancesWithCinderVolumes-1046896634 None] attachment_update completed successfully.
Sep 25 17:19:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-d31ae7ff-9110-41cf-bba3-1aa2c2a2ec9f req-607c55d2-28fa-4756-8728-53eb424f21e4 tempest-TestInstancesWithCinderVolumes-1046896634 None] Terminate volume connection completed successfully.
Sep 25 17:19:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-d31ae7ff-9110-41cf-bba3-1aa2c2a2ec9f req-607c55d2-28fa-4756-8728-53eb424f21e4 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleting attachment c9bd8f85-a1ba-43a1-8d4c-ce12a3cd0543. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-quobyte-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244dcab-5824-4c17-83b0-6ff049891ca4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:10 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe
Sep 25 17:19:10 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:10 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" returned: 0 in 0.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:10 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe
Sep 25 17:19:10 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:11 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" returned: 0 in 0.252s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe" released by "delete_volume" :: held 0.669s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:11 devstack cinder-volume[86955]: WARNING cinder.quota [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827621194-349772907 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827621194-349772907, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:11 devstack cinder-volume[86955]: WARNING cinder.quota [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827621194-349772907 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827621194-349772907, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Created reservations ['b18a3456-4877-4291-869d-6b6ffadf4cfd', 'ca9feaab-2ddc-4774-8f38-8922a22a5128', '03d92078-81e4-4946-8790-6291f3c83c21', 'f4e7ca74-dd11-4ba6-885f-cae0c9041a09'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:11 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:11 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:11 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleted volume successfully.
Sep 25 17:19:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15d0c1ae-09e6-449b-a961-7afb306ff9c5 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-855428f1-3da1-4e1f-8e72-9f1b48c3b1fe-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-03a81767-9396-459c-9e69-90d968574729 req-0e9ce8fa-f15d-4c9b-a942-a776716dcb51 tempest-TestInstancesWithCinderVolumes-1046896634 None] Terminate volume connection completed successfully.
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-03a81767-9396-459c-9e69-90d968574729 req-0e9ce8fa-f15d-4c9b-a942-a776716dcb51 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleting attachment 97ba8979-250d-49cb-bf90-735512c3699e. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-a6ac6f25-e2f1-4742-80d0-91d875067820-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-a6ac6f25-e2f1-4742-80d0-91d875067820-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-quobyte-a6ac6f25-e2f1-4742-80d0-91d875067820" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-a6ac6f25-e2f1-4742-80d0-91d875067820" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea0b8b6-0a57-4a40-9f52-5665be2bc9fb]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:14 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820
Sep 25 17:19:14 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:15 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820" returned: 0 in 0.439s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:15 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820
Sep 25 17:19:15 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:15 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a6ac6f25-e2f1-4742-80d0-91d875067820" returned: 0 in 0.271s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-a6ac6f25-e2f1-4742-80d0-91d875067820" released by "delete_volume" :: held 0.760s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:15 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1581913030-821873193 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1581913030-821873193, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:15 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1581913030-821873193 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1581913030-821873193, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Created reservations ['a9830ba2-2d19-4eb7-926b-5c22feba8cc0', 'a642549b-5ca8-41f3-bf00-6f253072e643', 'f12ebead-49c0-4e1c-8fa6-ca9dba72dae8', '306955e4-6872-456b-aee2-9dabf6ee05a8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:15 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:15 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:16 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.302s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleted volume successfully.
Sep 25 17:19:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e33c85d8-9c06-482c-a692-9ce8a71986e2 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-a6ac6f25-e2f1-4742-80d0-91d875067820-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-12a71a9e-9c57-44f6-8066-ab80c119c22d req-ed55cf36-3cc1-499e-bc6e-84d2f69b18d1 tempest-TestInstancesWithCinderVolumes-1046896634 None] Terminate volume connection completed successfully.
Sep 25 17:19:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-12a71a9e-9c57-44f6-8066-ab80c119c22d req-ed55cf36-3cc1-499e-bc6e-84d2f69b18d1 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleting attachment b114fe07-9cf3-40f5-86eb-6c02f2f3e253. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-2b6e5a01-cb49-4b47-acc8-f7c94cb92295-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-2b6e5a01-cb49-4b47-acc8-f7c94cb92295-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "cinder-quobyte-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf453f-36a1-4a69-a0f8-088ae8047716]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:20 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295
Sep 25 17:19:20 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:20 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" returned: 0 in 0.365s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:20 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295
Sep 25 17:19:20 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:20 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" returned: 0 in 0.234s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-quobyte-2b6e5a01-cb49-4b47-acc8-f7c94cb92295" released by "delete_volume" :: held 0.646s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:20 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504760047-685142045 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504760047-685142045, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:20 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504760047-685142045 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-504760047-685142045, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Created reservations ['def976ab-23cf-4716-bad2-0b8bdb7368df', '31e99e12-7b8c-415a-b783-95b657b00de0', 'ed44345e-ec79-4d39-b965-06c1bbb58efe', '3c5e17ae-7315-4425-bc7a-5a406921768a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:20 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:20 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:20 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.229s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Deleted volume successfully.
Sep 25 17:19:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5675036e-8ad5-4a7b-9047-125c66579e83 tempest-TestInstancesWithCinderVolumes-1046896634 None] Lock "cinder-2b6e5a01-cb49-4b47-acc8-f7c94cb92295-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:30 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=31,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:19:30 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Flow 'volume_create_manager' (605fa292-f921-4f82-9d5c-e65f194a861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6995a8a7-11ff-4112-9a2c-8820a2afa62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6995a8a7-11ff-4112-9a2c-8820a2afa62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f59f95-bcb4-42d6-ac79-983cf50d4783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3770841cb214a0694bfc7508dcfbffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:37Z,use_quota=True,user_id='4e1dcffb0ec24febab6cb0eba4a8033e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e83618-a172-42bd-a2c2-808a84a9ded9),volume_type_id=c3e83618-a172-42bd-a2c2-808a84a9ded9)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c79a515-0873-4aea-8659-eaeee00036ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c79a515-0873-4aea-8659-eaeee00036ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd543d5-1d54-4f96-8488-fbaa678182f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd543d5-1d54-4f96-8488-fbaa678182f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18f59f95-bcb4-42d6-ac79-983cf50d4783', 'volume_name': 'volume-18f59f95-bcb4-42d6-ac79-983cf50d4783', 'volume_size': 1, 'image_id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007613c94a00a0427cfd40d2e5ea7232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3770841cb214a0694bfc7508dcfbffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9d964e082df12875dac8c35c666841bb41ba035c4b35f72de6ff733d995dd95551780af17eb85b5c4e1a58439d2ce24fe440aafcb84a1a35f651eadb70a1cb6', 'id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f038c2c2-c93d-4c0e-9751-f627827cc601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abb9070>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d16ffe2-7515-41da-b98f-68a5da1e4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d16ffe2-7515-41da-b98f-68a5da1e4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb584b7e-d432-49c3-b463-9272b0d19ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Volume 18f59f95-bcb4-42d6-ac79-983cf50d4783: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18f59f95-bcb4-42d6-ac79-983cf50d4783', 'volume_size': 1, 'image_id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007613c94a00a0427cfd40d2e5ea7232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3770841cb214a0694bfc7508dcfbffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9d964e082df12875dac8c35c666841bb41ba035c4b35f72de6ff733d995dd95551780af17eb85b5c4e1a58439d2ce24fe440aafcb84a1a35f651eadb70a1cb6', 'id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f038c2c2-c93d-4c0e-9751-f627827cc601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abb9070>}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Trying to clone 18f59f95-bcb4-42d6-ac79-983cf50d4783 from image f038c2c2-c93d-4c0e-9751-f627827cc601 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:19:37 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b4d01b-6d38-4cc3-a534-0f12d9475839]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:37 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:37 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:37 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:37 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:37 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:38 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Temporary image f038c2c2-c93d-4c0e-9751-f627827cc601 is fetched for user 4e1dcffb0ec24febab6cb0eba4a8033e. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e5f65-d3de-4890-afdc-a287dad63b1d]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:38 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:38 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:38 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:38 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:38 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:38 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f59f95-bcb4-42d6-ac79-983cf50d4783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3770841cb214a0694bfc7508dcfbffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:37Z,use_quota=True,user_id='4e1dcffb0ec24febab6cb0eba4a8033e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e83618-a172-42bd-a2c2-808a84a9ded9),volume_type_id=c3e83618-a172-42bd-a2c2-808a84a9ded9)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Creating volume 18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:38 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:38 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1073741824
Sep 25 17:19:38 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:39 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1073741824" returned: 0 in 0.393s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:39 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783
Sep 25 17:19:39 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:39 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783" returned: 0 in 0.230s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Attempting download of f038c2c2-c93d-4c0e-9751-f627827cc601 ((None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}])) to volume 18f59f95-bcb4-42d6-ac79-983cf50d4783. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[353eb5cd-809d-4672-b2bb-132c1b8429fe]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:39 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4
Sep 25 17:19:39 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:39 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:40 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4
Sep 25 17:19:40 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:40 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4" returned: 1 in 0.312s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f038c2c2-c93d-4c0e-9751-f627827cc601_2r6_w_q4' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd68d1a7-4fb0-4c33-80ca-e8e305872684]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:40 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:40 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:40 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:40 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD
Sep 25 17:19:40 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:40 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] f038c2c2-c93d-4c0e-9751-f627827cc601 was raw, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:19:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:40 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783
Sep 25 17:19:40 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:41 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783" returned: 0 in 0.430s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f038c2c2-c93d-4c0e-9751-f627827cc601_yl3bhc2bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:19:41 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:41 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1G
Sep 25 17:19:41 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:41 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 1G" returned: 0 in 0.296s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Downloaded image f038c2c2-c93d-4c0e-9751-f627827cc601 ((None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}])) to volume 18f59f95-bcb4-42d6-ac79-983cf50d4783 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Temporary image f038c2c2-c93d-4c0e-9751-f627827cc601 for user 4e1dcffb0ec24febab6cb0eba4a8033e is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Marking volume 18f59f95-bcb4-42d6-ac79-983cf50d4783 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Copying metadata from image f038c2c2-c93d-4c0e-9751-f627827cc601 to 18f59f95-bcb4-42d6-ac79-983cf50d4783. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Creating volume glance metadata for volume 18f59f95-bcb4-42d6-ac79-983cf50d4783 backed by image f038c2c2-c93d-4c0e-9751-f627827cc601 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '007613c94a00a0427cfd40d2e5ea7232', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb584b7e-d432-49c3-b463-9272b0d19ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f59f95-bcb4-42d6-ac79-983cf50d4783', 'volume_size': 1, 'image_id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f038c2c2-c93d-4c0e-9751-f627827cc601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '007613c94a00a0427cfd40d2e5ea7232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3770841cb214a0694bfc7508dcfbffc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9d964e082df12875dac8c35c666841bb41ba035c4b35f72de6ff733d995dd95551780af17eb85b5c4e1a58439d2ce24fe440aafcb84a1a35f651eadb70a1cb6', 'id': 'f038c2c2-c93d-4c0e-9751-f627827cc601', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f038c2c2-c93d-4c0e-9751-f627827cc601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48abb9070>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b1ec1a-7205-4203-bd9c-55ba72ece4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Volume volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 (18f59f95-bcb4-42d6-ac79-983cf50d4783): created successfully
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b1ec1a-7205-4203-bd9c-55ba72ece4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Flow 'volume_create_manager' (605fa292-f921-4f82-9d5c-e65f194a861d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1b19ed21-0ba4-4fc7-9cfb-73a75972388f tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Created volume successfully.
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Acquiring lock "cinder-18f59f95-bcb4-42d6-ac79-983cf50d4783-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "cinder-18f59f95-bcb4-42d6-ac79-983cf50d4783-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Acquiring lock "cinder-quobyte-18f59f95-bcb4-42d6-ac79-983cf50d4783" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "cinder-quobyte-18f59f95-bcb4-42d6-ac79-983cf50d4783" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b10aefc-cc6d-40c7-9879-9dd96ec60eb2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:42 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783
Sep 25 17:19:42 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:42 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783" returned: 0 in 0.380s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:42 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783
Sep 25 17:19:42 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:43 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-18f59f95-bcb4-42d6-ac79-983cf50d4783" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "cinder-quobyte-18f59f95-bcb4-42d6-ac79-983cf50d4783" released by "delete_volume" :: held 0.686s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:43 devstack cinder-volume[86955]: WARNING cinder.quota [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:43 devstack cinder-volume[86955]: WARNING cinder.quota [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Created reservations ['256b01fc-fef4-45d9-91ae-f0cfa7ecab95', '5c067f28-f98d-4885-9e78-a37630b2910f', '223280b4-22c0-485a-8bfd-f000595a3c98', '2567fb5c-9fd8-451a-abc7-53da60bc8a75'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:43 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:43 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:43 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Deleted volume successfully.
Sep 25 17:19:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a974fa3b-e187-4251-9865-0544c78289b5 tempest-VolumeAndVolumeTypeFromImageTest-95485746 None] Lock "cinder-18f59f95-bcb4-42d6-ac79-983cf50d4783-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (987f6221-58c1-4d89-b7be-01e1ad59f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d2128-a60a-4ae8-b302-724cc160319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d2128-a60a-4ae8-b302-724cc160319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493936527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b43f8d-44fd-479b-ae13-02557b699f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c5c15b-eecb-4462-bc15-93ef2638a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c5c15b-eecb-4462-bc15-93ef2638a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8c7a3-3dee-4b35-86e1-d5bc846b0d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8c7a3-3dee-4b35-86e1-d5bc846b0d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b43f8d-44fd-479b-ae13-02557b699f6a', 'volume_name': 'volume-e3b43f8d-44fd-479b-ae13-02557b699f6a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4989421-1926-48da-9d7a-eaeaeeb08d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4989421-1926-48da-9d7a-eaeaeeb08d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e50ede-1de5-45ee-86af-61571d6d2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Volume e3b43f8d-44fd-479b-ae13-02557b699f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b43f8d-44fd-479b-ae13-02557b699f6a', 'volume_size': 1}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493936527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b43f8d-44fd-479b-ae13-02557b699f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Creating volume e3b43f8d-44fd-479b-ae13-02557b699f6a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:47 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a 1073741824
Sep 25 17:19:47 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (5ac68dde-b59e-4b46-9bbb-2832a7055027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaefc1c-72b8-4ab9-82d9-29d106f6dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaefc1c-72b8-4ab9-82d9-29d106f6dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841098109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c26b96-7a70-402c-95c1-5d31aaa3e662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1edfd-81eb-4e41-a083-72d1d5f27c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c1edfd-81eb-4e41-a083-72d1d5f27c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d473d6-cf00-46e5-8fb2-82169db63f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d473d6-cf00-46e5-8fb2-82169db63f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c26b96-7a70-402c-95c1-5d31aaa3e662', 'volume_name': 'volume-23c26b96-7a70-402c-95c1-5d31aaa3e662', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63e974-4680-4a55-8058-a6556aa8f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63e974-4680-4a55-8058-a6556aa8f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79137d8a-87c9-4103-a366-97d13e631265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Volume 23c26b96-7a70-402c-95c1-5d31aaa3e662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c26b96-7a70-402c-95c1-5d31aaa3e662', 'volume_size': 1}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:48 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a 1073741824" returned: 0 in 0.539s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:48 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a
Sep 25 17:19:48 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (44e5db51-95d1-43ee-bbc8-30b1c9f9b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510757a4-00c6-473b-b950-f92e1d0c364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510757a4-00c6-473b-b950-f92e1d0c364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336742739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4062c824-8d3d-4716-96dc-49c5bf16a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4062c824-8d3d-4716-96dc-49c5bf16a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f64d1f-3109-441a-a4de-87e70408a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f64d1f-3109-441a-a4de-87e70408a533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec', 'volume_name': 'volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd08ca5a-4d5e-4176-9ce4-d5f9089925dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd08ca5a-4d5e-4176-9ce4-d5f9089925dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2576f61a-38bb-47be-a453-198bae84605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Volume 71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec', 'volume_size': 1}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:48 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841098109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c26b96-7a70-402c-95c1-5d31aaa3e662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Creating volume 23c26b96-7a70-402c-95c1-5d31aaa3e662 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:48 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:48 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 1073741824
Sep 25 17:19:48 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e50ede-1de5-45ee-86af-61571d6d2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b43f8d-44fd-479b-ae13-02557b699f6a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9689934a-9d86-4bc1-85ea-cbc505519071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Volume volume-e3b43f8d-44fd-479b-ae13-02557b699f6a (e3b43f8d-44fd-479b-ae13-02557b699f6a): created successfully
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9689934a-9d86-4bc1-85ea-cbc505519071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (987f6221-58c1-4d89-b7be-01e1ad59f620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b6f92d1e-2d2e-47b9-9d8a-00db23ce6f69 tempest-CreateVolumesFromImageTest-1512480835 None] Created volume successfully.
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (f4e0e446-42f1-4599-9457-e91d04134071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0c8fb-90c0-4429-84cf-d39ea5eaf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0c8fb-90c0-4429-84cf-d39ea5eaf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448405237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e063e62-dc5e-444b-8865-49d6d403b335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de1a77-01aa-42d0-b1a5-df8c14adc2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de1a77-01aa-42d0-b1a5-df8c14adc2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6dab3d-873f-4fb4-b80e-7ff27824fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6dab3d-873f-4fb4-b80e-7ff27824fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e063e62-dc5e-444b-8865-49d6d403b335', 'volume_name': 'volume-0e063e62-dc5e-444b-8865-49d6d403b335', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8594cbaa-a8bf-43c4-8462-2d809c955ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8594cbaa-a8bf-43c4-8462-2d809c955ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718ba7fb-3da2-4031-90d4-454d3037b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Volume 0e063e62-dc5e-444b-8865-49d6d403b335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e063e62-dc5e-444b-8865-49d6d403b335', 'volume_size': 1}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:49 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 1073741824" returned: 0 in 0.541s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:49 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662
Sep 25 17:19:49 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (168c970c-3266-4232-baf6-b1a8a17d65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17106a71-2462-42d2-a25d-91b4635faa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17106a71-2462-42d2-a25d-91b4635faa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631949455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1fbfd1-918b-4f05-b62a-c2f837013025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69038c5-f5cb-470f-9fc5-270335c98fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69038c5-f5cb-470f-9fc5-270335c98fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c1c8c-2b3d-44b8-94ef-c749556be18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c1c8c-2b3d-44b8-94ef-c749556be18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1fbfd1-918b-4f05-b62a-c2f837013025', 'volume_name': 'volume-6f1fbfd1-918b-4f05-b62a-c2f837013025', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f76497-b2d4-40df-93d6-f6a90fde86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f76497-b2d4-40df-93d6-f6a90fde86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02bd0e8-0ae1-455a-b6cb-053824ee92fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Volume 6f1fbfd1-918b-4f05-b62a-c2f837013025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1fbfd1-918b-4f05-b62a-c2f837013025', 'volume_size': 1}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:49 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662" returned: 0 in 0.265s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336742739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:48Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Creating volume 71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:49 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec 1073741824
Sep 25 17:19:49 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79137d8a-87c9-4103-a366-97d13e631265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c26b96-7a70-402c-95c1-5d31aaa3e662', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97551914-19ba-4852-88c5-3331e823d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Volume volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 (23c26b96-7a70-402c-95c1-5d31aaa3e662): created successfully
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97551914-19ba-4852-88c5-3331e823d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (5ac68dde-b59e-4b46-9bbb-2832a7055027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-70a681c8-a79f-4ce1-b8d4-68d5a94b04a8 tempest-CreateVolumesFromImageTest-1512480835 None] Created volume successfully.
Sep 25 17:19:49 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec 1073741824" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:50 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec
Sep 25 17:19:50 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:50 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448405237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e063e62-dc5e-444b-8865-49d6d403b335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Creating volume 0e063e62-dc5e-444b-8865-49d6d403b335 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2576f61a-38bb-47be-a453-198bae84605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:50 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 1073741824
Sep 25 17:19:50 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450597a-1b6a-49f4-ab28-b734869a5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Volume volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec (71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec): created successfully
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450597a-1b6a-49f4-ab28-b734869a5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (44e5db51-95d1-43ee-bbc8-30b1c9f9b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-147b3a54-3215-40ec-9ea1-efa1e0a4d47c tempest-CreateVolumesFromImageTest-1512480835 None] Created volume successfully.
Sep 25 17:19:50 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 1073741824" returned: 0 in 0.430s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:50 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335
Sep 25 17:19:50 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:50 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.545s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631949455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1fbfd1-918b-4f05-b62a-c2f837013025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e036f06601246709971f31667cdc697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:49Z,use_quota=True,user_id='4de744c68dd740dfb29cc5d7308be4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Creating volume 6f1fbfd1-918b-4f05-b62a-c2f837013025 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:19:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718ba7fb-3da2-4031-90d4-454d3037b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e063e62-dc5e-444b-8865-49d6d403b335', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:51 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 1073741824
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13daede0-c89c-469b-ae02-6e6997cf2539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:51 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Volume volume-0e063e62-dc5e-444b-8865-49d6d403b335 (0e063e62-dc5e-444b-8865-49d6d403b335): created successfully
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13daede0-c89c-469b-ae02-6e6997cf2539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (f4e0e446-42f1-4599-9457-e91d04134071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-edac36b8-09d3-4c89-a29c-9c576a66a524 tempest-CreateVolumesFromImageTest-1512480835 None] Created volume successfully.
Sep 25 17:19:51 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 1073741824" returned: 0 in 0.456s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:51 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025
Sep 25 17:19:51 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:51 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02bd0e8-0ae1-455a-b6cb-053824ee92fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1fbfd1-918b-4f05-b62a-c2f837013025', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc347d5-7817-4db4-a81e-58c5744961bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:19:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Volume volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 (6f1fbfd1-918b-4f05-b62a-c2f837013025): created successfully
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc347d5-7817-4db4-a81e-58c5744961bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:19:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Flow 'volume_create_manager' (168c970c-3266-4232-baf6-b1a8a17d65ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:19:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7557addc-9cbd-4fef-80ca-4927cc0ba0d0 tempest-CreateVolumesFromImageTest-1512480835 None] Created volume successfully.
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-6f1fbfd1-918b-4f05-b62a-c2f837013025-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-6f1fbfd1-918b-4f05-b62a-c2f837013025-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-quobyte-6f1fbfd1-918b-4f05-b62a-c2f837013025" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-6f1fbfd1-918b-4f05-b62a-c2f837013025" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb311243-8a31-45ce-9769-72b94aa148fa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:52 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025
Sep 25 17:19:52 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:53 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025" returned: 0 in 0.369s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:53 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025
Sep 25 17:19:53 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:53 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6f1fbfd1-918b-4f05-b62a-c2f837013025" returned: 0 in 0.247s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-6f1fbfd1-918b-4f05-b62a-c2f837013025" released by "delete_volume" :: held 0.657s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Created reservations ['6eae6e3f-19a9-445f-b446-3d0fcc72bb55', '38656707-73cb-4637-972f-f82a13be1be7', '811a71de-1f42-461e-881b-54434e97ad75', 'c0433ae5-babc-4569-ac73-8706f1b51308'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:53 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:53 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Deleted volume successfully.
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-05065de5-4eb3-45f7-b5f8-463c84e3b958 tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-6f1fbfd1-918b-4f05-b62a-c2f837013025-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-0e063e62-dc5e-444b-8865-49d6d403b335-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-0e063e62-dc5e-444b-8865-49d6d403b335-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-quobyte-0e063e62-dc5e-444b-8865-49d6d403b335" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-0e063e62-dc5e-444b-8865-49d6d403b335" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbdd31c-8b84-4cfc-8321-3e5e6817e90a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:54 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335
Sep 25 17:19:54 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:54 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335" returned: 0 in 0.388s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:54 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335
Sep 25 17:19:54 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:54 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0e063e62-dc5e-444b-8865-49d6d403b335" returned: 0 in 0.239s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-0e063e62-dc5e-444b-8865-49d6d403b335" released by "delete_volume" :: held 0.669s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Created reservations ['a7fe0605-0116-4794-9fdf-59b0924d076b', 'aa59953c-169d-4539-8980-31f76f6c950a', '172351f8-fdc8-4e44-9d95-357eb0761a47', 'b1f012a9-972f-4051-a301-0c58e5fd926b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:54 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:54 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:55 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Deleted volume successfully.
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4b98b61-ca9d-41db-b3ff-21251eacc1cb tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-0e063e62-dc5e-444b-8865-49d6d403b335-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-quobyte-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d515d9-f2f9-4079-8bb2-66e3cee1632c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:55 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec
Sep 25 17:19:55 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:55 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" returned: 0 in 0.349s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:55 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec
Sep 25 17:19:55 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:55 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" returned: 0 in 0.241s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec" released by "delete_volume" :: held 0.629s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Created reservations ['f049d0e5-bae1-41de-9a34-bc7fcb43bc8e', '22befb01-bd22-4eff-b55f-ed5df2a5b549', 'fa4d99a6-d36c-416b-8c8a-32eace97b40f', 'f2f63c83-5d1c-4343-b3a8-790fc97a5a84'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:55 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:55 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:56 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.235s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Deleted volume successfully.
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b19a2ca3-71fc-4ef6-ab9f-4522b138342c tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-71f2e8e0-3e8d-45c0-9d1b-c5ce4a589aec-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-23c26b96-7a70-402c-95c1-5d31aaa3e662-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-23c26b96-7a70-402c-95c1-5d31aaa3e662-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-quobyte-23c26b96-7a70-402c-95c1-5d31aaa3e662" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-23c26b96-7a70-402c-95c1-5d31aaa3e662" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce571cb-4c2e-476f-9e26-3d17f91925df]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:56 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662
Sep 25 17:19:56 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:56 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662" returned: 0 in 0.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:56 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662
Sep 25 17:19:56 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:56 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-23c26b96-7a70-402c-95c1-5d31aaa3e662" returned: 0 in 0.237s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-23c26b96-7a70-402c-95c1-5d31aaa3e662" released by "delete_volume" :: held 0.622s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Created reservations ['4e356cb0-e8d8-40c1-b835-e3838cf4b232', 'a67b6ba5-08e9-4b1f-9b13-fb6dee8b4cab', '9e57feb3-2a63-4e72-b925-646db8a787f5', '9661dc99-4fec-45a5-b37c-1ba33177df5c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:57 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:57 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:57 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.237s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Deleted volume successfully.
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-135be0df-4cf6-45f8-814d-86a418b6c61a tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-23c26b96-7a70-402c-95c1-5d31aaa3e662-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-e3b43f8d-44fd-479b-ae13-02557b699f6a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-e3b43f8d-44fd-479b-ae13-02557b699f6a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "cinder-quobyte-e3b43f8d-44fd-479b-ae13-02557b699f6a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-e3b43f8d-44fd-479b-ae13-02557b699f6a" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd070ca-b2ab-4b20-84df-fa4e7aa10ac7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:57 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a
Sep 25 17:19:57 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:57 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a" returned: 0 in 0.382s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:57 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a
Sep 25 17:19:57 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:58 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e3b43f8d-44fd-479b-ae13-02557b699f6a" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-quobyte-e3b43f8d-44fd-479b-ae13-02557b699f6a" released by "delete_volume" :: held 0.676s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Created reservations ['04a8d7a0-1213-45ea-8245-b401c5e5ca2f', '0bc1bef1-e0c2-4118-a852-096519cde92a', 'b2536885-4b52-47b7-8fee-5d87d1b5ce1c', '2197360c-64ea-46c7-9ad5-6138251053bb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:19:58 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:19:58 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:19:58 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:19:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Deleted volume successfully.
Sep 25 17:19:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-436a0b78-0b1f-49ff-9135-ee63c2f268ae tempest-CreateVolumesFromImageTest-1512480835 None] Lock "cinder-e3b43f8d-44fd-479b-ae13-02557b699f6a-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (addad9c2-8f74-4f0e-bfbf-e49bf125e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aae54f-1ed9-42ba-af2d-c99735c70499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1aae54f-1ed9-42ba-af2d-c99735c70499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133172939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b53b96-f0df-4a1b-b925-4b6e13a8a276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72334b7d-c7b7-42f2-bb91-0e70104dc11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72334b7d-c7b7-42f2-bb91-0e70104dc11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d6eece-878f-4ad3-bc20-6f9dba2d01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d6eece-878f-4ad3-bc20-6f9dba2d01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b53b96-f0df-4a1b-b925-4b6e13a8a276', 'volume_name': 'volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80a8c1a-c172-459a-a59f-c61d873668a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80a8c1a-c172-459a-a59f-c61d873668a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca524658-bfa3-498c-a2fe-7547ed1b0197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume 31b53b96-f0df-4a1b-b925-4b6e13a8a276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276', 'volume_size': 1}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133172939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b53b96-f0df-4a1b-b925-4b6e13a8a276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume 31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:01 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 1073741824
Sep 25 17:20:01 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:02 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 1073741824" returned: 0 in 0.431s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:02 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276
Sep 25 17:20:02 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:02 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276" returned: 0 in 0.257s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca524658-bfa3-498c-a2fe-7547ed1b0197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066739c3-6f72-4224-a5b2-127a6a248e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 (31b53b96-f0df-4a1b-b925-4b6e13a8a276): created successfully
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066739c3-6f72-4224-a5b2-127a6a248e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (addad9c2-8f74-4f0e-bfbf-e49bf125e674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7f536328-818f-4b67-ac24-cc6c217f01f5 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating offline snapshot 5fad2d6f-1ba1-4b2f-826c-429f8420faf7 of volume 31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b40009-04cf-434f-95b3-ed21634f3d14]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:02 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276
Sep 25 17:20:02 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:03 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:03 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 1G
Sep 25 17:20:03 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:03 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 1G" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:03 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7
Sep 25 17:20:03 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:03 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:03 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:03 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7" returned: 0 in 0.312s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 is being set with open permissions: ugo+rw
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:03 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:20:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:20:03 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7
Sep 25 17:20:03 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:04 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7" returned: 0 in 0.241s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:04 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info
Sep 25 17:20:04 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:04 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info" returned: 0 in 0.247s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info is being set with open permissions: ugo+rw
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:04 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info
Sep 25 17:20:04 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:04 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.info" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-521c2adc-7913-4220-b37d-fcb9a7013865 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Create snapshot completed successfully
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (e2aae5ee-8da6-4283-befc-3c16ab2e7f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a62ce2-3a5b-4e30-af87-8669bd252594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a62ce2-3a5b-4e30-af87-8669bd252594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521908759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e388c450-ec4f-4a43-ad76-c6b5c2792607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:05Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc286b6a-1ca4-4451-a5f4-9c1926e3afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc286b6a-1ca4-4451-a5f4-9c1926e3afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b4636b-9083-44ff-855b-7202aa899558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b4636b-9083-44ff-855b-7202aa899558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e388c450-ec4f-4a43-ad76-c6b5c2792607', 'volume_name': 'volume-e388c450-ec4f-4a43-ad76-c6b5c2792607', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088653d3-828e-44ec-953c-273731f22888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088653d3-828e-44ec-953c-273731f22888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278697b8-4f44-4b19-bfb9-2459a893a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume e388c450-ec4f-4a43-ad76-c6b5c2792607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e388c450-ec4f-4a43-ad76-c6b5c2792607', 'volume_size': 1}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521908759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e388c450-ec4f-4a43-ad76-c6b5c2792607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:05Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume e388c450-ec4f-4a43-ad76-c6b5c2792607 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:05 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 1073741824
Sep 25 17:20:05 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (6abab26d-e9a5-4005-829b-f2e097c50a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fcab6-acb8-496a-bf8f-9c2880a0f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fcab6-acb8-496a-bf8f-9c2880a0f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031010130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4eba4ca-1867-41c2-8ed0-272b2281e9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6567dc4e-c772-4458-a346-55ecce984e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6567dc4e-c772-4458-a346-55ecce984e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1812eb5-44a8-48da-be68-2cd3115a91b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1812eb5-44a8-48da-be68-2cd3115a91b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4eba4ca-1867-41c2-8ed0-272b2281e9bf', 'volume_name': 'volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31cb662-d1cb-4283-95d8-e0f2921b1a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31cb662-d1cb-4283-95d8-e0f2921b1a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd71380-2b45-44c8-a935-90a1072f9a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume d4eba4ca-1867-41c2-8ed0-272b2281e9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf', 'volume_size': 1}
Sep 25 17:20:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:06 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 1073741824" returned: 0 in 0.586s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:06 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607
Sep 25 17:20:06 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (bace306c-193b-45b7-b8e7-375f280316dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d4831d-aab1-4525-aac1-ac7f13ca5b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d4831d-aab1-4525-aac1-ac7f13ca5b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555081362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ec1e2-ca3c-4a6a-b173-4702150ab716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a28945-c380-4a08-9bc9-9a6b6bc1fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a28945-c380-4a08-9bc9-9a6b6bc1fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ff84cc-97da-45e3-a9ab-16b05d0f9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ff84cc-97da-45e3-a9ab-16b05d0f9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930ec1e2-ca3c-4a6a-b173-4702150ab716', 'volume_name': 'volume-930ec1e2-ca3c-4a6a-b173-4702150ab716', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2364557b-c426-4ea2-8181-195675bac2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2364557b-c426-4ea2-8181-195675bac2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3141cd-c181-4be8-99fc-595a4273fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume 930ec1e2-ca3c-4a6a-b173-4702150ab716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930ec1e2-ca3c-4a6a-b173-4702150ab716', 'volume_size': 1}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:06 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607" returned: 0 in 0.287s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031010130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4eba4ca-1867-41c2-8ed0-272b2281e9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume d4eba4ca-1867-41c2-8ed0-272b2281e9bf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:06 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278697b8-4f44-4b19-bfb9-2459a893a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e388c450-ec4f-4a43-ad76-c6b5c2792607', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf 1073741824
Sep 25 17:20:06 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d83fba0-4edc-43e7-921c-126bc5cc4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 (e388c450-ec4f-4a43-ad76-c6b5c2792607): created successfully
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d83fba0-4edc-43e7-921c-126bc5cc4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (e2aae5ee-8da6-4283-befc-3c16ab2e7f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5f319bb9-2857-4e58-b3b9-a31c8ed5da6f tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (ce42ed93-9167-4fb3-a8af-67a766913112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a709b9-78e4-40de-830c-d240c46f6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a709b9-78e4-40de-830c-d240c46f6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728971293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80785a0-5ef5-458a-8109-b9ad98b1f1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:07Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51210d6-041c-4fb3-b030-42b8a261cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51210d6-041c-4fb3-b030-42b8a261cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b8f2f7-25e1-4b9f-a253-82f7d12391ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b8f2f7-25e1-4b9f-a253-82f7d12391ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80785a0-5ef5-458a-8109-b9ad98b1f1fd', 'volume_name': 'volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d15729-4852-416a-96ad-d42c74a17077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d15729-4852-416a-96ad-d42c74a17077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb977590-20e5-4fc4-a439-c407cd05c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume c80785a0-5ef5-458a-8109-b9ad98b1f1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd', 'volume_size': 1}
Sep 25 17:20:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:06 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf 1073741824" returned: 0 in 0.626s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:07 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf
Sep 25 17:20:07 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (950669c0-f8ba-4ee6-9f2b-c04b36c54185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d0748-0ccd-49bf-9d1d-a0fcb80923d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53d0748-0ccd-49bf-9d1d-a0fcb80923d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034681901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5188d5-2e76-4c01-b443-f614e746af19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:07Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f6aaa1-bbf7-4525-80b5-3dc982c02ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f6aaa1-bbf7-4525-80b5-3dc982c02ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f577f5af-dcb0-44d1-9eeb-0cf3a031f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f577f5af-dcb0-44d1-9eeb-0cf3a031f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5188d5-2e76-4c01-b443-f614e746af19', 'volume_name': 'volume-be5188d5-2e76-4c01-b443-f614e746af19', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a891bb6c-7393-4277-a3cd-5db06ea2c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a891bb6c-7393-4277-a3cd-5db06ea2c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c4372-5ab4-4dbb-b17e-3984428afe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume be5188d5-2e76-4c01-b443-f614e746af19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5188d5-2e76-4c01-b443-f614e746af19', 'volume_size': 1}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:07 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" returned: 0 in 0.301s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555081362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ec1e2-ca3c-4a6a-b173-4702150ab716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:06Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume 930ec1e2-ca3c-4a6a-b173-4702150ab716 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd71380-2b45-44c8-a935-90a1072f9a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 1073741824
Sep 25 17:20:07 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1532f1d-d3ea-4dcd-b2c6-c29f07dba7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf (d4eba4ca-1867-41c2-8ed0-272b2281e9bf): created successfully
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1532f1d-d3ea-4dcd-b2c6-c29f07dba7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (6abab26d-e9a5-4005-829b-f2e097c50a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-75e20c3e-f091-4ff0-9db9-b3dc8015aa87 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:07 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 1073741824" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:07 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716
Sep 25 17:20:07 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:08 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716" returned: 0 in 0.312s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728971293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80785a0-5ef5-458a-8109-b9ad98b1f1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:07Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume c80785a0-5ef5-458a-8109-b9ad98b1f1fd {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3141cd-c181-4be8-99fc-595a4273fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930ec1e2-ca3c-4a6a-b173-4702150ab716', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:08 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd 1073741824
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa23acd-770b-4976-9259-a449590fd3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:08 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 (930ec1e2-ca3c-4a6a-b173-4702150ab716): created successfully
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa23acd-770b-4976-9259-a449590fd3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (bace306c-193b-45b7-b8e7-375f280316dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d29f9a24-3d0d-4600-8a9b-329e7f0f0306 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:08 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd 1073741824" returned: 0 in 0.484s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:08 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd
Sep 25 17:20:08 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:08 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1034681901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5188d5-2e76-4c01-b443-f614e746af19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7e4c5bd80542cc9c1a8c00063a68c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:07Z,use_quota=True,user_id='fc256b204fd74a9bbe43dcf1b1a5da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Creating volume be5188d5-2e76-4c01-b443-f614e746af19 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:09 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb977590-20e5-4fc4-a439-c407cd05c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:09 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 1073741824
Sep 25 17:20:09 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5e8fe-fc1b-4723-b559-1282663e4830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd (c80785a0-5ef5-458a-8109-b9ad98b1f1fd): created successfully
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb5e8fe-fc1b-4723-b559-1282663e4830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (ce42ed93-9167-4fb3-a8af-67a766913112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-564866e7-ab8a-4169-b0d0-5caa1d0093f9 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:09 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 1073741824" returned: 0 in 0.502s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:09 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19
Sep 25 17:20:09 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:09 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0c4372-5ab4-4dbb-b17e-3984428afe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5188d5-2e76-4c01-b443-f614e746af19', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582769da-5852-4148-8e18-63224b2895b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Volume volume-be5188d5-2e76-4c01-b443-f614e746af19 (be5188d5-2e76-4c01-b443-f614e746af19): created successfully
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582769da-5852-4148-8e18-63224b2895b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Flow 'volume_create_manager' (950669c0-f8ba-4ee6-9f2b-c04b36c54185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9da9cd94-fa32-41b7-a208-56f48b56ce95 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created volume successfully.
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-be5188d5-2e76-4c01-b443-f614e746af19-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-be5188d5-2e76-4c01-b443-f614e746af19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-be5188d5-2e76-4c01-b443-f614e746af19" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-be5188d5-2e76-4c01-b443-f614e746af19" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea195fa6-23b6-465f-87f3-74b906926abd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:10 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19
Sep 25 17:20:10 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:11 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19" returned: 0 in 0.446s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:11 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19
Sep 25 17:20:11 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:11 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-be5188d5-2e76-4c01-b443-f614e746af19" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-be5188d5-2e76-4c01-b443-f614e746af19" released by "delete_volume" :: held 0.792s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['e8acab19-84ff-416e-ba4f-2d58231221c1', '89484c4f-8c0c-4a8d-a71d-e837c20fa740', 'd6ede945-19ed-42b8-bc35-f08ee2787b2a', '4db549c7-e037-473d-9e3e-682deb8dcdfb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:11 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:11 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-c80785a0-5ef5-458a-8109-b9ad98b1f1fd-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-c80785a0-5ef5-458a-8109-b9ad98b1f1fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2c9a0-e65a-4c87-a700-1fca33c8e6f9]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:11 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.328s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-82037d23-d03b-4d0f-9106-c07cdf30908b tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-be5188d5-2e76-4c01-b443-f614e746af19-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:12 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd
Sep 25 17:20:12 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:12 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:12 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd
Sep 25 17:20:12 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:12 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-c80785a0-5ef5-458a-8109-b9ad98b1f1fd" released by "delete_volume" :: held 0.722s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['1ce0ea52-402f-490d-87d2-464e3aa4b063', '82b8914d-e15a-4301-88bb-a5bd40af2745', '9c88af66-8d20-4163-83b6-7b61334d6069', 'acd67e7b-c04e-416f-8554-e4020d3f04e5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:12 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:12 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-930ec1e2-ca3c-4a6a-b173-4702150ab716-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:12 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-930ec1e2-ca3c-4a6a-b173-4702150ab716-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0bfb153-1add-4828-94ed-d78a9401c5be tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-c80785a0-5ef5-458a-8109-b9ad98b1f1fd-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-930ec1e2-ca3c-4a6a-b173-4702150ab716" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-930ec1e2-ca3c-4a6a-b173-4702150ab716" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b2786-2cef-4d8d-a6c3-c8bfbba9c37d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:13 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716
Sep 25 17:20:13 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:13 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716" returned: 0 in 0.347s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:13 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716
Sep 25 17:20:13 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:13 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-930ec1e2-ca3c-4a6a-b173-4702150ab716" returned: 0 in 0.234s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-930ec1e2-ca3c-4a6a-b173-4702150ab716" released by "delete_volume" :: held 0.625s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['b8476141-adfb-4cc7-831d-41b7f8ed9eb8', '932c665d-f0e1-4c30-9732-c522fb9339fb', '29c5a1b6-9e58-42ca-a58b-7b0c2ff0ec63', 'c653293e-cd2f-4da2-900c-a201250d10a8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:13 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:13 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:14 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.316s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-d4eba4ca-1867-41c2-8ed0-272b2281e9bf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa245524-12e8-4a0c-b6aa-41bb225b6c79 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-930ec1e2-ca3c-4a6a-b173-4702150ab716-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-d4eba4ca-1867-41c2-8ed0-272b2281e9bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06d78f-1dd9-4afe-8248-74a7a51246b3]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:14 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf
Sep 25 17:20:14 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:14 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:14 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf
Sep 25 17:20:14 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:14 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" returned: 0 in 0.236s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-d4eba4ca-1867-41c2-8ed0-272b2281e9bf" released by "delete_volume" :: held 0.652s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:14 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['555ec21b-2fd5-4d32-9c3c-e5e2479641c9', 'c3dbb425-3dbb-493a-906b-b14c58f93d7c', '9b637365-e992-4a18-a363-4c230584e56f', '7eff0746-5466-4b4a-8e41-38ede134ce31'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:15 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:15 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:15 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-e388c450-ec4f-4a43-ad76-c6b5c2792607-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-e388c450-ec4f-4a43-ad76-c6b5c2792607-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a14ee576-c439-4c63-b36d-9cbe1723b936 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-d4eba4ca-1867-41c2-8ed0-272b2281e9bf-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-e388c450-ec4f-4a43-ad76-c6b5c2792607" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-e388c450-ec4f-4a43-ad76-c6b5c2792607" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f201161-635d-448e-8472-d5eb8fc25098]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:15 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607
Sep 25 17:20:15 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:15 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:15 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607
Sep 25 17:20:15 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:16 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e388c450-ec4f-4a43-ad76-c6b5c2792607" returned: 0 in 0.230s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-e388c450-ec4f-4a43-ad76-c6b5c2792607" released by "delete_volume" :: held 0.645s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['ef4ce6fe-c8a8-4e46-95e2-e9d1f285b741', '0c2fe812-1fbb-41bf-8d43-aa9066c7e7f7', '5b9a4c89-866a-4323-9ac5-4a814e70e1dc', 'ca26c50a-3cee-4328-bf36-045a6a1690e9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:16 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:16 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:16 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.241s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b27478d4-e004-4bd9-86e3-fa0f1a2c9dd0 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-e388c450-ec4f-4a43-ad76-c6b5c2792607-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-5fad2d6f-1ba1-4b2f-826c-429f8420faf7-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-5fad2d6f-1ba1-4b2f-826c-429f8420faf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-5fad2d6f-1ba1-4b2f-826c-429f8420faf7" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-5fad2d6f-1ba1-4b2f-826c-429f8420faf7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleting offline snapshot 5fad2d6f-1ba1-4b2f-826c-429f8420faf7 of volume 31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] snapshot_file for this snap is: volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8eeb8c-9213-424c-b4fa-5f9eb1ebff22]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:16 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7
Sep 25 17:20:16 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:16 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7" returned: 0 in 0.348s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a241866-157c-40d1-a63d-99a3a1748b9c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:17 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276
Sep 25 17:20:17 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:17 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276" returned: 0 in 0.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:17 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7
Sep 25 17:20:17 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:17 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7" returned: 0 in 0.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:17 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7
Sep 25 17:20:17 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:17 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276.5fad2d6f-1ba1-4b2f-826c-429f8420faf7" returned: 0 in 0.247s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-5fad2d6f-1ba1-4b2f-826c-429f8420faf7" released by "_delete_snapshot" :: held 1.408s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" released by "delete_snapshot" :: held 1.431s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['ebfd7941-5ee6-4c7f-98f9-893c1f8c23e5', '1ba6a766-aa7b-4506-9961-b8384312e576', 'c86ca71d-ccec-47ff-a815-47920a6b00fa', 'ad6f9a3e-0801-498b-bcd0-b6014468e020'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Delete snapshot completed successfully.
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c612be01-fc44-4227-83a7-2c74622eb5ef tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-5fad2d6f-1ba1-4b2f-826c-429f8420faf7-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-31b53b96-f0df-4a1b-b925-4b6e13a8a276-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-31b53b96-f0df-4a1b-b925-4b6e13a8a276-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[09da858c-6fe1-47a6-8a79-4f194ecefd4c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:18 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276
Sep 25 17:20:18 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:19 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276" returned: 0 in 0.370s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:19 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276
Sep 25 17:20:19 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:19 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-31b53b96-f0df-4a1b-b925-4b6e13a8a276" returned: 0 in 0.238s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-quobyte-31b53b96-f0df-4a1b-b925-4b6e13a8a276" released by "delete_volume" :: held 0.665s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Created reservations ['2a75e2e4-ae3c-4e0c-b8ab-1861aa4aef86', 'b9c734f5-06fc-47a0-9fd3-4a66e79ba727', '304ec900-99bc-42cf-854f-827adfa5bd86', '672b9bda-9d4d-44b9-a01f-b891e72ad31a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:19 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:19 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:19 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.233s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Deleted volume successfully.
Sep 25 17:20:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f31bd80c-202e-46bc-a947-330ff6c0abf7 tempest-CreateVolumesFromSnapshotTest-1377310478 None] Lock "cinder-31b53b96-f0df-4a1b-b925-4b6e13a8a276-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Flow 'volume_create_manager' (b90085c7-8eef-4775-ac05-ab3a48895273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e786db59-705c-4a60-9353-b079f8995403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e786db59-705c-4a60-9353-b079f8995403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236160798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9ac382-3cb5-486f-8981-378e41effd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42132e798c3c4cc0bf32b67f3062b6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:23Z,use_quota=True,user_id='b535f9700fc64df2a1874a92231cdba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64896f3d-790b-49fe-99ab-a995939f59c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64896f3d-790b-49fe-99ab-a995939f59c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1822fb-86e2-410e-b962-4fe37a1b71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1822fb-86e2-410e-b962-4fe37a1b71a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9ac382-3cb5-486f-8981-378e41effd00', 'volume_name': 'volume-bb9ac382-3cb5-486f-8981-378e41effd00', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5831c5be-0108-46a8-9354-b2c7a9ebe4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5831c5be-0108-46a8-9354-b2c7a9ebe4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ccbaa5-df7a-45f4-aecd-9fff6ae0af9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Volume bb9ac382-3cb5-486f-8981-378e41effd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9ac382-3cb5-486f-8981-378e41effd00', 'volume_size': 1}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236160798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9ac382-3cb5-486f-8981-378e41effd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42132e798c3c4cc0bf32b67f3062b6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:23Z,use_quota=True,user_id='b535f9700fc64df2a1874a92231cdba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Creating volume bb9ac382-3cb5-486f-8981-378e41effd00 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:23 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 1073741824
Sep 25 17:20:23 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:23 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 1073741824" returned: 0 in 0.412s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:23 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00
Sep 25 17:20:23 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:23 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00" returned: 0 in 0.256s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ccbaa5-df7a-45f4-aecd-9fff6ae0af9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9ac382-3cb5-486f-8981-378e41effd00', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9cbe9-ad53-4182-8a9f-2eebadd19861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Volume volume-bb9ac382-3cb5-486f-8981-378e41effd00 (bb9ac382-3cb5-486f-8981-378e41effd00): created successfully
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9cbe9-ad53-4182-8a9f-2eebadd19861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Flow 'volume_create_manager' (b90085c7-8eef-4775-ac05-ab3a48895273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-493a6304-6c67-4e33-bfdb-39df0178c2f7 tempest-ProjectReaderTests-268782410 None] Created volume successfully.
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Acquiring lock "cinder-bb9ac382-3cb5-486f-8981-378e41effd00-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "cinder-bb9ac382-3cb5-486f-8981-378e41effd00-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Acquiring lock "cinder-quobyte-bb9ac382-3cb5-486f-8981-378e41effd00" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "cinder-quobyte-bb9ac382-3cb5-486f-8981-378e41effd00" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c30a0d-5be4-4dfa-b06f-8ed0548a9cf8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:24 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00
Sep 25 17:20:24 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:24 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:24 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00
Sep 25 17:20:24 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:24 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-bb9ac382-3cb5-486f-8981-378e41effd00" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "cinder-quobyte-bb9ac382-3cb5-486f-8981-378e41effd00" released by "delete_volume" :: held 0.678s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Created reservations ['4cef644c-c8f4-473a-aa1d-7cfc18466959', '155a93db-e7d8-43b0-a267-5fe5590781cc', '162e7cdb-8087-4116-8d2c-8abe7cd437cf', 'b131383b-9e69-4054-add9-1f669d6d13d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:25 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:25 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:25 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Deleted volume successfully.
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cfb1e6ff-fc13-4bc9-a961-54f962c0f75c tempest-ProjectReaderTests-268782410 None] Lock "cinder-bb9ac382-3cb5-486f-8981-378e41effd00-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Flow 'volume_create_manager' (468455e2-6231-4f05-84bc-22c92c1ed55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467b6bb0-c8b1-4318-a027-40e638b3f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467b6bb0-c8b1-4318-a027-40e638b3f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055832896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2dcaf3-b637-4416-b1aa-284bd3619255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42132e798c3c4cc0bf32b67f3062b6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:26Z,use_quota=True,user_id='b535f9700fc64df2a1874a92231cdba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e167ac-31f2-4f97-9be0-dd9885c4aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e167ac-31f2-4f97-9be0-dd9885c4aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d5afea-2fd0-4bdb-8635-2f39918e26ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d5afea-2fd0-4bdb-8635-2f39918e26ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2dcaf3-b637-4416-b1aa-284bd3619255', 'volume_name': 'volume-2a2dcaf3-b637-4416-b1aa-284bd3619255', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb41975d-cdb5-4510-a7e5-b3dfec0d4f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb41975d-cdb5-4510-a7e5-b3dfec0d4f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3b2cc3-9491-4bec-a8eb-524e26f141a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Volume 2a2dcaf3-b637-4416-b1aa-284bd3619255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2dcaf3-b637-4416-b1aa-284bd3619255', 'volume_size': 1}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055832896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2dcaf3-b637-4416-b1aa-284bd3619255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42132e798c3c4cc0bf32b67f3062b6d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:26Z,use_quota=True,user_id='b535f9700fc64df2a1874a92231cdba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Creating volume 2a2dcaf3-b637-4416-b1aa-284bd3619255 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:25 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 1073741824
Sep 25 17:20:25 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:26 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 1073741824" returned: 0 in 0.442s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:26 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255
Sep 25 17:20:26 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:26 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255" returned: 0 in 0.247s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3b2cc3-9491-4bec-a8eb-524e26f141a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2dcaf3-b637-4416-b1aa-284bd3619255', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e25311b-5c5b-428f-8a12-a486156e6057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Volume volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 (2a2dcaf3-b637-4416-b1aa-284bd3619255): created successfully
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e25311b-5c5b-428f-8a12-a486156e6057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Flow 'volume_create_manager' (468455e2-6231-4f05-84bc-22c92c1ed55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a8d2e7fc-21df-47b7-9f0c-2e24cb930cb6 tempest-ProjectReaderTests-268782410 None] Created volume successfully.
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Acquiring lock "cinder-2a2dcaf3-b637-4416-b1aa-284bd3619255-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "cinder-2a2dcaf3-b637-4416-b1aa-284bd3619255-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Acquiring lock "cinder-quobyte-2a2dcaf3-b637-4416-b1aa-284bd3619255" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "cinder-quobyte-2a2dcaf3-b637-4416-b1aa-284bd3619255" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc297dfa-6814-49c7-ab9d-87d0c2148ea1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:27 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255
Sep 25 17:20:27 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:27 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255" returned: 0 in 0.383s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:27 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255
Sep 25 17:20:27 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:27 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-2a2dcaf3-b637-4416-b1aa-284bd3619255" returned: 0 in 0.244s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "cinder-quobyte-2a2dcaf3-b637-4416-b1aa-284bd3619255" released by "delete_volume" :: held 0.669s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Created reservations ['6d04f57b-33f0-499a-b705-5cd107e9dde8', 'd3f63b2a-85da-4d56-9a9b-dfa45d884697', 'fcb870a9-be8c-4b19-bcc4-50dcd64b7a08', '32b476a3-52f2-4316-a956-9190b78789b8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:27 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:27 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:27 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Deleted volume successfully.
Sep 25 17:20:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0efa2b00-d35a-4291-b990-ad55707e71c4 tempest-ProjectReaderTests-268782410 None] Lock "cinder-2a2dcaf3-b637-4416-b1aa-284bd3619255-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=166,cinder:SELECT=110,cinder:INSERT=46,cinder:DELETE=11 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=118,cinder:UPDATE=161,cinder:INSERT=39,cinder:DELETE=18 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (9fdef064-fee0-4edc-ab3d-69d6074ecbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463cb742-a412-49a4-bf45-4db2937b159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463cb742-a412-49a4-bf45-4db2937b159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494074425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4154ac7-4783-4b97-a094-d19191652cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151363c6-2526-41b6-8d43-ae0ce6f9c771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151363c6-2526-41b6-8d43-ae0ce6f9c771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c02038-aa51-4464-b857-982e821a9fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c02038-aa51-4464-b857-982e821a9fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4154ac7-4783-4b97-a094-d19191652cfa', 'volume_name': 'volume-a4154ac7-4783-4b97-a094-d19191652cfa', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fc9657-309f-4848-b3e0-3ae4c8399979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fc9657-309f-4848-b3e0-3ae4c8399979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d49ad-d223-485a-9a8e-19c9e6ee992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Volume a4154ac7-4783-4b97-a094-d19191652cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4154ac7-4783-4b97-a094-d19191652cfa', 'volume_size': 1}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494074425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4154ac7-4783-4b97-a094-d19191652cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:37Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Creating volume a4154ac7-4783-4b97-a094-d19191652cfa {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:37 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa 1073741824
Sep 25 17:20:37 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:37 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa 1073741824" returned: 0 in 0.440s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:37 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa
Sep 25 17:20:37 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:38 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa" returned: 0 in 0.264s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d49ad-d223-485a-9a8e-19c9e6ee992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4154ac7-4783-4b97-a094-d19191652cfa', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb56ed30-1c67-4d3f-a6e1-97b625bed72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Volume volume-a4154ac7-4783-4b97-a094-d19191652cfa (a4154ac7-4783-4b97-a094-d19191652cfa): created successfully
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb56ed30-1c67-4d3f-a6e1-97b625bed72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (9fdef064-fee0-4edc-ab3d-69d6074ecbf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c4b064ef-3583-4435-b009-da1aa1b8c515 tempest-ProjectReaderTests-378199871 None] Created volume successfully.
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-a4154ac7-4783-4b97-a094-d19191652cfa-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "cinder-a4154ac7-4783-4b97-a094-d19191652cfa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-quobyte-a4154ac7-4783-4b97-a094-d19191652cfa" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-a4154ac7-4783-4b97-a094-d19191652cfa" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e7815-3c5d-40cf-9429-10efc417a7ea]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:38 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa
Sep 25 17:20:38 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:38 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa" returned: 0 in 0.376s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:38 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa
Sep 25 17:20:38 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:39 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-a4154ac7-4783-4b97-a094-d19191652cfa" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-a4154ac7-4783-4b97-a094-d19191652cfa" released by "delete_volume" :: held 0.690s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Created reservations ['08508bf4-3305-492c-8e6c-ea3ffd0b68dd', 'cb39dd03-0c31-4198-8ce9-c6a188a2c3e4', 'a92e842a-3142-4f02-88a8-a2cdb42fcfd6', '6e78655b-c2b5-4bc9-8553-c4a760c47c64'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:39 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:39 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:39 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Deleted volume successfully.
Sep 25 17:20:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0a6223dd-2cbf-49ef-aa84-d9bf7007d86a tempest-ProjectReaderTests-378199871 None] Lock "cinder-a4154ac7-4783-4b97-a094-d19191652cfa-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (0c3a4005-dfe8-43d1-b152-4acb1be86b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3412d6e-e037-410e-be69-b18ec17c00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3412d6e-e037-410e-be69-b18ec17c00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995293790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e5a61e-8d7b-461a-9868-a8ec35b9a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:40Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4dbfdc-11f1-4893-8cae-83a88513e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4dbfdc-11f1-4893-8cae-83a88513e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9b38cc-af37-49e1-910d-d612ba80b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9b38cc-af37-49e1-910d-d612ba80b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e5a61e-8d7b-461a-9868-a8ec35b9a3b1', 'volume_name': 'volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefe712-2745-442d-8582-fc55863fdefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eefe712-2745-442d-8582-fc55863fdefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb6c0eb-5526-438f-af64-8317c14e158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Volume 77e5a61e-8d7b-461a-9868-a8ec35b9a3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1', 'volume_size': 1}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995293790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e5a61e-8d7b-461a-9868-a8ec35b9a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:40Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Creating volume 77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:40 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:40 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 1073741824
Sep 25 17:20:40 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:40 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 1073741824" returned: 0 in 0.458s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:40 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1
Sep 25 17:20:40 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:40 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" returned: 0 in 0.243s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb6c0eb-5526-438f-af64-8317c14e158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d391c4-7ab9-4a26-ad39-d18e218aad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Volume volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 (77e5a61e-8d7b-461a-9868-a8ec35b9a3b1): created successfully
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d391c4-7ab9-4a26-ad39-d18e218aad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (0c3a4005-dfe8-43d1-b152-4acb1be86b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cb0db7e9-3785-4229-8ea7-cfb90eb53efd tempest-ProjectReaderTests-378199871 None] Created volume successfully.
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "cinder-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-quobyte-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c986e9-230f-47bd-9d2c-576b9fc0aa4e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:41 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1
Sep 25 17:20:41 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:41 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" returned: 0 in 0.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:41 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1
Sep 25 17:20:41 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:41 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1" released by "delete_volume" :: held 0.653s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Created reservations ['72299d58-3488-4be5-92e7-43c6b18841ab', 'ad701e41-a17b-4143-bc7c-b479610df59a', '748b0523-7bb8-4c9e-9d87-fa4810b8f4db', 'cec65b61-7d15-414c-b5c6-4958a9c8cc89'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:41 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:41 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:42 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.307s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Deleted volume successfully.
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-484e5d02-6def-4a18-bb3f-7166c9bc7d62 tempest-ProjectReaderTests-378199871 None] Lock "cinder-77e5a61e-8d7b-461a-9868-a8ec35b9a3b1-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (516b51c6-8a6d-40b7-956f-479ac9b61dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041eabcb-7b24-42bc-a202-ad0b382bddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041eabcb-7b24-42bc-a202-ad0b382bddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625555550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba15d905-e4ce-4993-926a-c2d7fed662a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:43Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdd088e-05cd-4bd7-93fa-61c0bb24f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdd088e-05cd-4bd7-93fa-61c0bb24f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd351ac1-5c48-474b-8717-bb32e9f55738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd351ac1-5c48-474b-8717-bb32e9f55738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba15d905-e4ce-4993-926a-c2d7fed662a2', 'volume_name': 'volume-ba15d905-e4ce-4993-926a-c2d7fed662a2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011381ba-1f52-4d80-b87f-2aad8fdb4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011381ba-1f52-4d80-b87f-2aad8fdb4600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac6400-fd70-442e-80e8-ddc757c1b43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Volume ba15d905-e4ce-4993-926a-c2d7fed662a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba15d905-e4ce-4993-926a-c2d7fed662a2', 'volume_size': 1}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625555550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba15d905-e4ce-4993-926a-c2d7fed662a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:43Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Creating volume ba15d905-e4ce-4993-926a-c2d7fed662a2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:42 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 1073741824
Sep 25 17:20:42 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:43 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 1073741824" returned: 0 in 0.436s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:43 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2
Sep 25 17:20:43 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:43 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2" returned: 0 in 0.270s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac6400-fd70-442e-80e8-ddc757c1b43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba15d905-e4ce-4993-926a-c2d7fed662a2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f25c3-6c45-4f9d-b58f-a2035b46018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Volume volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 (ba15d905-e4ce-4993-926a-c2d7fed662a2): created successfully
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981f25c3-6c45-4f9d-b58f-a2035b46018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (516b51c6-8a6d-40b7-956f-479ac9b61dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-162c22ee-90b3-41dc-9b51-351708e8cc8c tempest-ProjectReaderTests-378199871 None] Created volume successfully.
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-ba15d905-e4ce-4993-926a-c2d7fed662a2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "cinder-ba15d905-e4ce-4993-926a-c2d7fed662a2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-quobyte-ba15d905-e4ce-4993-926a-c2d7fed662a2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-ba15d905-e4ce-4993-926a-c2d7fed662a2" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dcae44-28a1-414a-b21b-6062c4594a5f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:44 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2
Sep 25 17:20:44 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:44 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2" returned: 0 in 0.396s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:44 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2
Sep 25 17:20:44 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:44 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba15d905-e4ce-4993-926a-c2d7fed662a2" returned: 0 in 0.285s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-ba15d905-e4ce-4993-926a-c2d7fed662a2" released by "delete_volume" :: held 0.730s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Created reservations ['0472b22d-883f-4448-b1fe-6a842b6c4823', '7c6c66d4-c783-4e7e-ae1c-3efe5dabc47c', '6d73a62d-a7d4-4b2c-b2de-d63e41ccb2b2', '3f8ee886-28a3-430c-8c8e-c1778e7ceac9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:44 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:44 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:45 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.319s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Deleted volume successfully.
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5f54b87-4a22-4bdd-a871-68c127d87e66 tempest-ProjectReaderTests-378199871 None] Lock "cinder-ba15d905-e4ce-4993-926a-c2d7fed662a2-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (8d2f1057-5cb7-4f00-b027-ef986726a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0057be6-99e0-4d44-b46e-9044ca3581fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0057be6-99e0-4d44-b46e-9044ca3581fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185261424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae2569-58f1-4b5c-8ec4-4f1c77ceb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:45Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dffa4c-373a-492f-8f16-a702f093652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dffa4c-373a-492f-8f16-a702f093652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb3583c-53ba-4124-9e92-85dde09a8d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb3583c-53ba-4124-9e92-85dde09a8d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ae2569-58f1-4b5c-8ec4-4f1c77ceb490', 'volume_name': 'volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9fec6e-1325-4e93-9a15-0f56f1882302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9fec6e-1325-4e93-9a15-0f56f1882302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f6fa78-314d-4072-b6db-e69adb98974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Volume 73ae2569-58f1-4b5c-8ec4-4f1c77ceb490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490', 'volume_size': 1}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185261424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae2569-58f1-4b5c-8ec4-4f1c77ceb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='894b19b35b6642fd8afc1a2784f4679b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:45Z,use_quota=True,user_id='3c760e9da3f34066b867b010b793ebbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Creating volume 73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:20:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:20:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:45 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 1073741824
Sep 25 17:20:45 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:46 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 1073741824" returned: 0 in 0.427s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:46 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490
Sep 25 17:20:46 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:46 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f6fa78-314d-4072-b6db-e69adb98974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aade80-c137-4dd2-ab6b-b17e805544f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:20:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Volume volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 (73ae2569-58f1-4b5c-8ec4-4f1c77ceb490): created successfully
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72aade80-c137-4dd2-ab6b-b17e805544f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Flow 'volume_create_manager' (8d2f1057-5cb7-4f00-b027-ef986726a28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:20:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-70be8b0f-b7a3-4b4e-93c0-3988715aff0e tempest-ProjectReaderTests-378199871 None] Created volume successfully.
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "cinder-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Acquiring lock "cinder-quobyte-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e9cdf9-12ed-4891-bd52-61aa741a57c2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:20:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:46 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490
Sep 25 17:20:46 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:47 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:47 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490
Sep 25 17:20:47 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:47 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "cinder-quobyte-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490" released by "delete_volume" :: held 0.672s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Created reservations ['4e48351b-3b24-4bdd-95cf-d8ae34dd968b', 'c8ee3b68-fff8-43c1-897e-ab6dc5842dd2', '42eba61e-b00c-4d44-9191-cc78d21da2b8', '3ce3a39a-e275-4a97-a0ed-89e048501bd2'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:20:47 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:20:47 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:20:47 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:20:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Deleted volume successfully.
Sep 25 17:20:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bd2fdbaa-307e-41bc-8f6d-327536e791f5 tempest-ProjectReaderTests-378199871 None] Lock "cinder-73ae2569-58f1-4b5c-8ec4-4f1c77ceb490-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:20:57 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=26,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:20:57 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:03 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:21:03 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:03 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.276s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:21:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Flow 'volume_create_manager' (119e2736-c6b7-4b02-9ab1-3ed7b281778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e3a1c-c704-4160-b9b3-9d1e7550d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7e3a1c-c704-4160-b9b3-9d1e7550d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-418598768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c42c8e0-4283-4036-b326-4b1636d85111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e752eb101877476e869cd9fea0c3ac7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:08Z,use_quota=True,user_id='1d8ce7b971e3491c98b5bc91555040fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815017d7-ab02-4d9e-98d3-7257a4c3b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815017d7-ab02-4d9e-98d3-7257a4c3b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e3762c-4b54-4094-9767-ba70441b7dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e3762c-4b54-4094-9767-ba70441b7dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c42c8e0-4283-4036-b326-4b1636d85111', 'volume_name': 'volume-7c42c8e0-4283-4036-b326-4b1636d85111', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba2a29c-3caf-4cc9-be1d-c5b990410fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba2a29c-3caf-4cc9-be1d-c5b990410fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0e5afb-6a5a-4e22-abe7-a26231253b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Volume 7c42c8e0-4283-4036-b326-4b1636d85111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c42c8e0-4283-4036-b326-4b1636d85111', 'volume_size': 1}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-418598768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c42c8e0-4283-4036-b326-4b1636d85111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e752eb101877476e869cd9fea0c3ac7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:08Z,use_quota=True,user_id='1d8ce7b971e3491c98b5bc91555040fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Creating volume 7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:08 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 1073741824
Sep 25 17:21:08 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:08 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 1073741824" returned: 0 in 0.416s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:08 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:08 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:08 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.242s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0e5afb-6a5a-4e22-abe7-a26231253b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c42c8e0-4283-4036-b326-4b1636d85111', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81b9740-db55-4035-a703-d8fbf02825f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Volume volume-7c42c8e0-4283-4036-b326-4b1636d85111 (7c42c8e0-4283-4036-b326-4b1636d85111): created successfully
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81b9740-db55-4035-a703-d8fbf02825f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Flow 'volume_create_manager' (119e2736-c6b7-4b02-9ab1-3ed7b281778d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e72b5c03-664d-4682-9671-cd5fbfd760a4 tempest-SnapshotDependencyTests-531750755 None] Created volume successfully.
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Creating offline snapshot c0be9fa7-004d-4420-aadf-94ae097635c4 of volume 7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20fa32-61aa-4cfd-a31c-09d94fcc9979]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:09 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:09 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:09 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:09 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 1G
Sep 25 17:21:09 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:10 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 1G" returned: 0 in 0.381s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c42c8e0-4283-4036-b326-4b1636d85111 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:10 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c42c8e0-4283-4036-b326-4b1636d85111 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:10 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:10 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c42c8e0-4283-4036-b326-4b1636d85111 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:10 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 is being set with open permissions: ugo+rw
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:10 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:10 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:10 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.268s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:10 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info
Sep 25 17:21:10 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:10 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info" returned: 0 in 0.252s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:10 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info is being set with open permissions: ugo+rw
Sep 25 17:21:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:11 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info
Sep 25 17:21:11 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:11 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.info" returned: 0 in 0.246s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-477f0a66-8652-47f6-8725-caf811d3e684 tempest-SnapshotDependencyTests-531750755 None] Create snapshot completed successfully
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Flow 'volume_create_manager' (8e22f238-7dd9-4bdf-b473-baf90db69c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44288859-d4be-435d-b073-6fd2a219b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44288859-d4be-435d-b073-6fd2a219b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c83e51-031f-4d3e-9914-a77e8f6856f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e752eb101877476e869cd9fea0c3ac7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0be9fa7-004d-4420-aadf-94ae097635c4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:12Z,use_quota=True,user_id='1d8ce7b971e3491c98b5bc91555040fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2f697-5891-4ef0-9d77-68a427709e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde2f697-5891-4ef0-9d77-68a427709e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f58a14-1c9e-4e22-8585-e8fc56de58bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f58a14-1c9e-4e22-8585-e8fc56de58bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22c83e51-031f-4d3e-9914-a77e8f6856f0', 'volume_name': 'volume-22c83e51-031f-4d3e-9914-a77e8f6856f0', 'volume_size': 1, 'snapshot_id': 'c0be9fa7-004d-4420-aadf-94ae097635c4'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0546df6a-e4ab-4490-a045-d2f4ee1ea8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0546df6a-e4ab-4490-a045-d2f4ee1ea8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4540695-9041-4765-a511-254d94ae040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Volume 22c83e51-031f-4d3e-9914-a77e8f6856f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22c83e51-031f-4d3e-9914-a77e8f6856f0', 'volume_size': 1, 'snapshot_id': 'c0be9fa7-004d-4420-aadf-94ae097635c4'}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4-22c83e51-031f-4d3e-9914-a77e8f6856f0" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4-22c83e51-031f-4d3e-9914-a77e8f6856f0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Creating volume 22c83e51-031f-4d3e-9914-a77e8f6856f0 from snapshot c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] snapshot: c0be9fa7-004d-4420-aadf-94ae097635c4, volume: 22c83e51-031f-4d3e-9914-a77e8f6856f0,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[37110f49-bda4-49b1-b5ea-60540b59dd6b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:12 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:12 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:12 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c42c8e0-4283-4036-b326-4b1636d85111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa1626-c235-4f1f-91c8-b8ae5e1c3f79]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:12 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:12 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:12 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.361s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:21:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:21:13 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:21:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:13 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0
Sep 25 17:21:13 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:18 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0" returned: 0 in 5.718s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:21:18 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Converted 1024.00 MB image at 179.02 MB/s
Sep 25 17:21:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 is being set with open permissions: ugo+rw
Sep 25 17:21:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:18 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0
Sep 25 17:21:18 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:18 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0" returned: 0 in 0.239s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" released by "_copy_volume_from_snapshot" :: held 6.755s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4-22c83e51-031f-4d3e-9914-a77e8f6856f0" released by "_create_volume_from_snapshot" :: held 6.829s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.844s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4540695-9041-4765-a511-254d94ae040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c83e51-031f-4d3e-9914-a77e8f6856f0', 'volume_size': 1, 'snapshot_id': 'c0be9fa7-004d-4420-aadf-94ae097635c4'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bd149b-48dc-45ad-93d9-f1e774ac9d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Volume volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 (22c83e51-031f-4d3e-9914-a77e8f6856f0): created successfully
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bd149b-48dc-45ad-93d9-f1e774ac9d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Flow 'volume_create_manager' (8e22f238-7dd9-4bdf-b473-baf90db69c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-44d34e73-1577-42f3-b804-c26ad091153a tempest-SnapshotDependencyTests-531750755 None] Created volume successfully.
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-c0be9fa7-004d-4420-aadf-94ae097635c4-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-c0be9fa7-004d-4420-aadf-94ae097635c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Deleting offline snapshot c0be9fa7-004d-4420-aadf-94ae097635c4 of volume 7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] snapshot_file for this snap is: volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[073b2e81-38b9-493a-9762-73e0bccb410c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:19 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:19 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:20 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.405s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c42c8e0-4283-4036-b326-4b1636d85111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e06d9c-4b9e-4a0c-b5fa-9d090fe264f2]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:20 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:20 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:20 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.540s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:20 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:20 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:21 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:21 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4
Sep 25 17:21:21 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:21 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111.c0be9fa7-004d-4420-aadf-94ae097635c4" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-c0be9fa7-004d-4420-aadf-94ae097635c4" released by "_delete_snapshot" :: held 1.657s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" released by "delete_snapshot" :: held 1.682s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Created reservations ['84533cfe-a6ce-4d7e-8762-9cc54ced8ec6', '1bf53a0b-c1b5-427b-a6ff-c78eddb33a8f', '0c689c3b-91a2-4392-a4dc-0389b9bc2a59', '1f7b7c9d-ee38-4d4b-ad2d-b1e537fe31d1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:21:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Delete snapshot completed successfully.
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b3aa62b7-b6d2-43cb-b5af-cf9aff361275 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-c0be9fa7-004d-4420-aadf-94ae097635c4-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-7c42c8e0-4283-4036-b326-4b1636d85111-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-7c42c8e0-4283-4036-b326-4b1636d85111-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1056c5-135d-4a38-81c6-c2c3fb76d0ab]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:22 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:22 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:22 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:22 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111
Sep 25 17:21:22 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:22 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7c42c8e0-4283-4036-b326-4b1636d85111" returned: 0 in 0.241s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-7c42c8e0-4283-4036-b326-4b1636d85111" released by "delete_volume" :: held 0.671s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Created reservations ['22c2db1f-f356-4bce-88db-15444bdae9e3', 'e325f9bd-5f8e-4cce-a250-073220883508', '9290be57-ec3d-4526-a9c5-8c860b04f29a', '7780a973-4f2c-47c8-bb91-5125e62c1db8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:22 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:21:22 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:22 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:21:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Deleted volume successfully.
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6ded1509-082b-4953-b444-02066cb40d0d tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-7c42c8e0-4283-4036-b326-4b1636d85111-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-22c83e51-031f-4d3e-9914-a77e8f6856f0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-22c83e51-031f-4d3e-9914-a77e8f6856f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[874238b4-f5f5-4e11-b164-0371b6ba1b0d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:23 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0
Sep 25 17:21:23 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:23 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0" returned: 0 in 0.383s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:23 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0
Sep 25 17:21:23 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:23 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-22c83e51-031f-4d3e-9914-a77e8f6856f0" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-quobyte-22c83e51-031f-4d3e-9914-a77e8f6856f0" released by "delete_volume" :: held 0.673s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Created reservations ['56b65c05-e11b-4353-9b21-285a2aed8ead', '4ca0c637-e788-4014-bf65-da0a4a2e7a87', '031c6559-d02e-4ad0-a91b-f8390d2b8a40', 'c6860952-8440-4dd8-8ccf-3a33875d6378'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:23 devstack sudo[106552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:21:23 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:24 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:21:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Deleted volume successfully.
Sep 25 17:21:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5b0baa00-967e-4dfa-bd3c-6e5300760c64 tempest-SnapshotDependencyTests-531750755 None] Lock "cinder-22c83e51-031f-4d3e-9914-a77e8f6856f0-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:21:33 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=32,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:21:34 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (a5f40134-47d9-48b0-a0ec-e1e846027d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2efe1b3-dffb-4374-99a6-527488132526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2efe1b3-dffb-4374-99a6-527488132526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580304310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784582fd-9a09-4ff1-a167-e0e39a538f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:45Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effcfa5b-32cf-4a5d-9388-ee56347e9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effcfa5b-32cf-4a5d-9388-ee56347e9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de26724-32ef-4004-8c99-ccbb09785695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de26724-32ef-4004-8c99-ccbb09785695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784582fd-9a09-4ff1-a167-e0e39a538f0d', 'volume_name': 'volume-784582fd-9a09-4ff1-a167-e0e39a538f0d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316f09e-53f4-4bcd-99d3-f100186572ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316f09e-53f4-4bcd-99d3-f100186572ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02196ea2-ce20-45d1-b9bf-3dd05ed13ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume 784582fd-9a09-4ff1-a167-e0e39a538f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784582fd-9a09-4ff1-a167-e0e39a538f0d', 'volume_size': 1}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580304310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784582fd-9a09-4ff1-a167-e0e39a538f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:45Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume 784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:45 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d 1073741824
Sep 25 17:21:45 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (d503f1fe-e72e-4ed9-9abb-46895bd65795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ade706e-477d-4371-85de-b618b0dcc3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ade706e-477d-4371-85de-b618b0dcc3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767986163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12ef295-9324-4c92-b7b9-fe04a1141de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:46Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae26c92-4c6b-48e8-a17e-a608da0c09d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae26c92-4c6b-48e8-a17e-a608da0c09d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a46038-338d-44ca-91f5-8af09abe5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a46038-338d-44ca-91f5-8af09abe5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12ef295-9324-4c92-b7b9-fe04a1141de8', 'volume_name': 'volume-c12ef295-9324-4c92-b7b9-fe04a1141de8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ea7c4b-1701-43f0-bc0d-13fb3ef7d476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ea7c4b-1701-43f0-bc0d-13fb3ef7d476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270997b1-1e49-4c06-874a-2540823ca348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume c12ef295-9324-4c92-b7b9-fe04a1141de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12ef295-9324-4c92-b7b9-fe04a1141de8', 'volume_size': 1}
Sep 25 17:21:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:46 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d 1073741824" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Flow 'volume_create_manager' (b7e7d520-a5f1-44c1-9ec5-d7cdd47de1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519546fb-7cad-44ab-a510-1ab607c5612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:46 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d
Sep 25 17:21:46 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519546fb-7cad-44ab-a510-1ab607c5612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a6c843-a1e1-48b6-b315-b4c49fadc73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e588887b6ac44d43921d66e0419152a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:46Z,use_quota=True,user_id='0130436d581149878798845c2dc651d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3113adf-1447-4e10-b334-9bd633eb1c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3113adf-1447-4e10-b334-9bd633eb1c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8135ce2-1c99-4a08-b949-254b2e60b850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8135ce2-1c99-4a08-b949-254b2e60b850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a6c843-a1e1-48b6-b315-b4c49fadc73f', 'volume_name': 'volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dab48c-251d-4223-8971-9db1bd5ee0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dab48c-251d-4223-8971-9db1bd5ee0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2948de-b74c-4af2-b045-bd1018492a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Volume 79a6c843-a1e1-48b6-b315-b4c49fadc73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f', 'volume_size': 1}
Sep 25 17:21:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:47 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d" returned: 0 in 0.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.205s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767986163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12ef295-9324-4c92-b7b9-fe04a1141de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:46Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume c12ef295-9324-4c92-b7b9-fe04a1141de8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02196ea2-ce20-45d1-b9bf-3dd05ed13ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784582fd-9a09-4ff1-a167-e0e39a538f0d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:47 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 1073741824
Sep 25 17:21:47 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75b8656-5603-46fe-add2-972e85a101a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-784582fd-9a09-4ff1-a167-e0e39a538f0d (784582fd-9a09-4ff1-a167-e0e39a538f0d): created successfully
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75b8656-5603-46fe-add2-972e85a101a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (a5f40134-47d9-48b0-a0ec-e1e846027d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-eb124db6-13e1-4cdc-9cc5-f9f58f003b45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:21:47 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 1073741824" returned: 0 in 0.527s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:47 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8
Sep 25 17:21:47 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:47 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a6c843-a1e1-48b6-b315-b4c49fadc73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e588887b6ac44d43921d66e0419152a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:46Z,use_quota=True,user_id='0130436d581149878798845c2dc651d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Creating volume 79a6c843-a1e1-48b6-b315-b4c49fadc73f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:48 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270997b1-1e49-4c06-874a-2540823ca348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12ef295-9324-4c92-b7b9-fe04a1141de8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:48 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f 1073741824
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3762aa-af87-4b60-92cf-64c9e4ebabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:48 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 (c12ef295-9324-4c92-b7b9-fe04a1141de8): created successfully
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3762aa-af87-4b60-92cf-64c9e4ebabf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (d503f1fe-e72e-4ed9-9abb-46895bd65795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b1c9f28-ff2f-4b67-b150-c57cd6c9f7ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:48 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f 1073741824" returned: 0 in 0.547s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:48 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f
Sep 25 17:21:48 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:48 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.451s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2948de-b74c-4af2-b045-bd1018492a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2393201d-32a1-45fc-bb0c-5ebfc707af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating offline snapshot c549bcb5-b090-4cc9-9004-b09a58d920f0 of volume 784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:21:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Volume volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f (79a6c843-a1e1-48b6-b315-b4c49fadc73f): created successfully
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2393201d-32a1-45fc-bb0c-5ebfc707af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Flow 'volume_create_manager' (b7e7d520-a5f1-44c1-9ec5-d7cdd47de1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ed16d4-914d-40b1-936d-59ff0854a511]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-157a88d8-8bbe-4678-9e7c-538001f2bf61 tempest-CinderUnicodeTest-1220636739 None] Created volume successfully.
Sep 25 17:21:49 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d
Sep 25 17:21:49 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:49 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d" returned: 0 in 0.461s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:49 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 1G
Sep 25 17:21:49 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (166ffdab-aef7-46e8-9af2-419618ccf292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d36ee34-985a-4046-afa9-c6496667b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d36ee34-985a-4046-afa9-c6496667b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549190765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474c553c-1f0c-43a3-a74c-a5896059bdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:49Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8055d5-ad12-479f-9393-5330a2385f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8055d5-ad12-479f-9393-5330a2385f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70556c7e-2cc6-47a6-b11d-39c29c2a789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70556c7e-2cc6-47a6-b11d-39c29c2a789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474c553c-1f0c-43a3-a74c-a5896059bdc0', 'volume_name': 'volume-474c553c-1f0c-43a3-a74c-a5896059bdc0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62d5083-46b3-4843-acfb-48b84457fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62d5083-46b3-4843-acfb-48b84457fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995ce98-ecc0-4a4d-b4fc-426d095ff13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume 474c553c-1f0c-43a3-a74c-a5896059bdc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474c553c-1f0c-43a3-a74c-a5896059bdc0', 'volume_size': 1}
Sep 25 17:21:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:50 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 1G" returned: 0 in 0.624s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784582fd-9a09-4ff1-a167-e0e39a538f0d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:50 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784582fd-9a09-4ff1-a167-e0e39a538f0d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0
Sep 25 17:21:50 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Flow 'volume_create_manager' (ba83d516-bf95-47b7-a83b-befee16450b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f5a3b6-c8fd-4a1b-b68b-41534eaf3f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f5a3b6-c8fd-4a1b-b68b-41534eaf3f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d398388-3105-4d17-8295-57d31ccd4c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651dbf01ee0a4143a95366dcdfeb6085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:50Z,use_quota=True,user_id='b580d9fee5034b808a30c5a5b92d7dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ec092be-8378-480a-a211-0118bb6dca3d),volume_type_id=9ec092be-8378-480a-a211-0118bb6dca3d)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c31056-6b86-4ff5-a922-47749dfcc26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:50 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c31056-6b86-4ff5-a922-47749dfcc26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ec3f5-065f-483b-bd30-e7c126284001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784582fd-9a09-4ff1-a167-e0e39a538f0d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0" returned: 0 in 0.505s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 is being set with open permissions: ugo+rw
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:50 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0
Sep 25 17:21:50 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:50 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79ec3f5-065f-483b-bd30-e7c126284001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d398388-3105-4d17-8295-57d31ccd4c12', 'volume_name': 'volume-0d398388-3105-4d17-8295-57d31ccd4c12', 'volume_size': 1, 'image_id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa50e3c157a95333def3bac45b191871', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '651dbf01ee0a4143a95366dcdfeb6085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99c48f5b4e7921a47976b7362adefb59e8581f63e70a61555680dcc74c4f75e630433835fc9d31dc34f6a8b4d95c1e88de69973cc2629312e4dfe22687987ed4', 'id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'created_at': datetime.datetime(2026, 9, 25, 15, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab8fe00>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564d7f7d-6c99-4bec-9dc0-8e99e25bc6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564d7f7d-6c99-4bec-9dc0-8e99e25bc6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de5ce9-7bf5-4a69-bd0c-0f2e4bad91d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Volume 0d398388-3105-4d17-8295-57d31ccd4c12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d398388-3105-4d17-8295-57d31ccd4c12', 'volume_size': 1, 'image_id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa50e3c157a95333def3bac45b191871', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '651dbf01ee0a4143a95366dcdfeb6085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99c48f5b4e7921a47976b7362adefb59e8581f63e70a61555680dcc74c4f75e630433835fc9d31dc34f6a8b4d95c1e88de69973cc2629312e4dfe22687987ed4', 'id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'created_at': datetime.datetime(2026, 9, 25, 15, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab8fe00>}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Trying to clone 0d398388-3105-4d17-8295-57d31ccd4c12 from image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0" returned: 0 in 0.459s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (8561eb56-b452-4f46-8a0a-5d411bcd57a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc00b90-742b-41c7-b60f-55bfde14b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc00b90-742b-41c7-b60f-55bfde14b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1096404239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2234a7-326b-4f51-8736-9fcbaf108b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:51Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c2ae23-d5e5-4937-8d82-974d07ab42f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c2ae23-d5e5-4937-8d82-974d07ab42f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c394fee-8a7f-4d98-97c9-119ee37d6ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c394fee-8a7f-4d98-97c9-119ee37d6ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2234a7-326b-4f51-8736-9fcbaf108b4e', 'volume_name': 'volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd02731f-73a5-4f75-9cde-b7b3f9b65d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd02731f-73a5-4f75-9cde-b7b3f9b65d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeec7b18-b993-423b-b154-25df8a7880cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume 3d2234a7-326b-4f51-8736-9fcbaf108b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e', 'volume_size': 1}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:21:51 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 17:21:51 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info
Sep 25 17:21:51 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:51 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info" returned: 0 in 0.285s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:51 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info is being set with open permissions: ugo+rw
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:51 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info
Sep 25 17:21:51 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:51 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.info" returned: 0 in 0.280s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.131s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549190765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474c553c-1f0c-43a3-a74c-a5896059bdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:49Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume 474c553c-1f0c-43a3-a74c-a5896059bdc0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:51 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 1073741824
Sep 25 17:21:51 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:52 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 1073741824" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7e9ac4-ce3f-45d1-af5f-f79ab613c836]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:53 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:21:53 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:54 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:54 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:21:54 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:54 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:21:54 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Temporary image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 is fetched for user b580d9fee5034b808a30c5a5b92d7dbc. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:21:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2dab262b-7412-46cc-ac09-0265fc284210 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Create snapshot completed successfully
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f00aaa-3efd-4d69-a154-b485fb539c32]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:56 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:56 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (84ffdba9-49c8-47e0-81e0-3150fb610108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba8d9cc-4c66-4c42-bb1d-bfaef240bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:56 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:21:56 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Flow 'volume_create_manager' (e18126fa-613b-4e0d-a930-9b5891e50db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea881e35-b9b2-4690-8bb6-dc51af58897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba8d9cc-4c66-4c42-bb1d-bfaef240bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950103850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f10789-3f3b-48a9-969c-e8cd7dfa1757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:51Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82cf5a-5064-455e-9342-f4521cb18d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82cf5a-5064-455e-9342-f4521cb18d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc95d02-7835-412e-bacf-79157bfd8c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc95d02-7835-412e-bacf-79157bfd8c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f10789-3f3b-48a9-969c-e8cd7dfa1757', 'volume_name': 'volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea7e256-d06b-4811-896e-1840d8a4b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea7e256-d06b-4811-896e-1840d8a4b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f23cd47-3d8b-41f4-a7b1-02e6957a04da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume e1f10789-3f3b-48a9-969c-e8cd7dfa1757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757', 'volume_size': 1}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea881e35-b9b2-4690-8bb6-dc51af58897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-912834856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77edef9-973e-45f8-871d-74bc2c13f175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e588887b6ac44d43921d66e0419152a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:54Z,use_quota=True,user_id='0130436d581149878798845c2dc651d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c805f27-e710-4807-ba67-6968566b35be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c805f27-e710-4807-ba67-6968566b35be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e2c049-e7f1-4b22-94e6-fea2c1ed6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e2c049-e7f1-4b22-94e6-fea2c1ed6734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77edef9-973e-45f8-871d-74bc2c13f175', 'volume_name': 'volume-e77edef9-973e-45f8-871d-74bc2c13f175', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4157dd-7cd4-4328-840d-fbf5bd96f451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4157dd-7cd4-4328-840d-fbf5bd96f451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ded9de-1cc1-4998-b658-dc22e0ec5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Volume e77edef9-973e-45f8-871d-74bc2c13f175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77edef9-973e-45f8-871d-74bc2c13f175', 'volume_size': 1}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:57 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0" returned: 0 in 0.453s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (5446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.452s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.081s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1096404239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2234a7-326b-4f51-8736-9fcbaf108b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:51Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume 3d2234a7-326b-4f51-8736-9fcbaf108b4e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995ce98-ecc0-4a4d-b4fc-426d095ff13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474c553c-1f0c-43a3-a74c-a5896059bdc0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e 1073741824
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e555a75b-a237-4e1b-b5af-7f5b8c286314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:57 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:21:57 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (81623495-cdc6-4631-adbf-5ea946bbdc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6984ea-b11f-4ebc-bf62-983822650f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 (474c553c-1f0c-43a3-a74c-a5896059bdc0): created successfully
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e555a75b-a237-4e1b-b5af-7f5b8c286314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (166ffdab-aef7-46e8-9af2-419618ccf292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6984ea-b11f-4ebc-bf62-983822650f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791142344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0737c4-d987-429b-afe8-b184b5743148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:57Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd575e-55ba-44b1-8c0d-6abe9da69ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd575e-55ba-44b1-8c0d-6abe9da69ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac98814c-7b71-45b4-87e6-6267edf97927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac98814c-7b71-45b4-87e6-6267edf97927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0737c4-d987-429b-afe8-b184b5743148', 'volume_name': 'volume-aa0737c4-d987-429b-afe8-b184b5743148', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1b391c-97ec-406f-aaa8-25e8009f07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1b391c-97ec-406f-aaa8-25e8009f07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e4178-60a7-4181-83cf-b9a2870f19c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume aa0737c4-d987-429b-afe8-b184b5743148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0737c4-d987-429b-afe8-b184b5743148', 'volume_size': 1}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (0b41b6f3-442e-42af-8190-25b6ed2a7635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ee4d53-f943-4fa0-8cdd-29880dfbb408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d29375dd-ae66-4e0b-8621-51fb68bf29d6 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ee4d53-f943-4fa0-8cdd-29880dfbb408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324474867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0355df45-bf30-4c47-b26d-08983a2d3690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:57Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e7e1e9-7478-4399-b1c0-54de09f533db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e7e1e9-7478-4399-b1c0-54de09f533db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdaceb1-f829-42ef-9110-0b7895f45e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdaceb1-f829-42ef-9110-0b7895f45e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0355df45-bf30-4c47-b26d-08983a2d3690', 'volume_name': 'volume-0355df45-bf30-4c47-b26d-08983a2d3690', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444534a8-0df5-40cc-8229-532601f63f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444534a8-0df5-40cc-8229-532601f63f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c652436-8571-455e-a073-770e8fb2266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume 0355df45-bf30-4c47-b26d-08983a2d3690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0355df45-bf30-4c47-b26d-08983a2d3690', 'volume_size': 1}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 1 in 0.488s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (6a22fa66-8d5a-4e0d-8880-ffb99d196837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aad777f-c5c0-48cb-b832-7a97dd3a27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aad777f-c5c0-48cb-b832-7a97dd3a27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145363421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b9439-86c6-4fd1-892a-d9c283bdcd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:58Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452a25b7-65c1-4a3d-9419-f987a94a9589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452a25b7-65c1-4a3d-9419-f987a94a9589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35d853-5a55-4ad8-911c-357fe5dc19a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35d853-5a55-4ad8-911c-357fe5dc19a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976b9439-86c6-4fd1-892a-d9c283bdcd8b', 'volume_name': 'volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303ed35e-72c7-40b9-998c-23a08c840908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (303ed35e-72c7-40b9-998c-23a08c840908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d109f608-04dd-49de-9efe-c14e3130b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:57 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume 976b9439-86c6-4fd1-892a-d9c283bdcd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b', 'volume_size': 1}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:57 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e 1073741824" returned: 0 in 0.652s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:57 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e
Sep 25 17:21:57 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (4aaedd9c-13a4-46e2-8b01-72b4e407766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9184ff2f-5e06-4bdb-966d-a41b9f19b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9184ff2f-5e06-4bdb-966d-a41b9f19b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040223632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d934d1e-7c0d-46df-8c96-90d6e35787bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:58Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8cc4e-5adc-4fd8-86c7-69c7f9120600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8cc4e-5adc-4fd8-86c7-69c7f9120600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26328346-4a3b-4bee-96be-8e3a55f94856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26328346-4a3b-4bee-96be-8e3a55f94856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d934d1e-7c0d-46df-8c96-90d6e35787bc', 'volume_name': 'volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e275dcfa-5079-4fc8-af06-39dcbbf10551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e275dcfa-5079-4fc8-af06-39dcbbf10551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162d8cbe-8378-40d8-9351-68985712d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume 0d934d1e-7c0d-46df-8c96-90d6e35787bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc', 'volume_size': 1}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e" returned: 0 in 0.388s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950103850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f10789-3f3b-48a9-969c-e8cd7dfa1757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:51Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume e1f10789-3f3b-48a9-969c-e8cd7dfa1757 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeec7b18-b993-423b-b154-25df8a7880cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 1073741824
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d7d813-5bce-4f6d-9d51-e0cb0b7ad285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e (3d2234a7-326b-4f51-8736-9fcbaf108b4e): created successfully
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d7d813-5bce-4f6d-9d51-e0cb0b7ad285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (8561eb56-b452-4f46-8a0a-5d411bcd57a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e9a9d4c1-33df-4b69-8e52-ae4b1a068eeb tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (e19a6f3f-a18d-42a4-a370-4fec8f5fb6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09641b23-a3bb-488f-8c29-ab1612f43a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09641b23-a3bb-488f-8c29-ab1612f43a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736770036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026bc6b3-8cb6-46a9-90b6-6284d030c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026bc6b3-8cb6-46a9-90b6-6284d030c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c8748b-8bf2-4962-b544-1dc0bd1b8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c8748b-8bf2-4962-b544-1dc0bd1b8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33', 'volume_name': 'volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b7175d-965c-4595-b205-04bcdadef319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b7175d-965c-4595-b205-04bcdadef319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6950e4-16aa-4137-9fac-fa063bf2c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33', 'volume_size': 1}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:58 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 1073741824" returned: 0 in 0.531s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:58 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757
Sep 25 17:21:58 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (58a63251-df59-4a6a-846c-3b83074bdcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3430305-73a7-4196-84c9-16a63a731276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3430305-73a7-4196-84c9-16a63a731276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923221443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e2e401-5682-417f-b07f-021ab1c949c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442e872-eac6-45c1-aa90-f7dc00242be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7442e872-eac6-45c1-aa90-f7dc00242be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc27112d-f5cb-47f8-9149-f86077af9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc27112d-f5cb-47f8-9149-f86077af9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e2e401-5682-417f-b07f-021ab1c949c2', 'volume_name': 'volume-87e2e401-5682-417f-b07f-021ab1c949c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42aed03-083d-4a9a-8bae-5007dfb55f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42aed03-083d-4a9a-8bae-5007dfb55f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214e6a33-c16b-4e7c-9258-e1d8f1c2afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume 87e2e401-5682-417f-b07f-021ab1c949c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e2e401-5682-417f-b07f-021ab1c949c2', 'volume_size': 1}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:59 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" returned: 0 in 0.300s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-912834856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77edef9-973e-45f8-871d-74bc2c13f175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e588887b6ac44d43921d66e0419152a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:54Z,use_quota=True,user_id='0130436d581149878798845c2dc651d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Creating volume e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:59 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 1073741824
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f23cd47-3d8b-41f4-a7b1-02e6957a04da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b27c797-3ffb-44d2-8f37-4ded0d35e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 (e1f10789-3f3b-48a9-969c-e8cd7dfa1757): created successfully
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b27c797-3ffb-44d2-8f37-4ded0d35e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (84ffdba9-49c8-47e0-81e0-3150fb610108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f723dd18-90fa-46af-8cac-d0a82b19ccc8 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (6da034a9-576e-4bc5-aacb-d3f45b300d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d55c9e-6a3e-424a-91b6-0a09da3e3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d55c9e-6a3e-424a-91b6-0a09da3e3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820082313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4780686b-b8a7-4f57-ad34-720892e9cd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30895601-fc8d-4754-b1fc-7086fecf7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30895601-fc8d-4754-b1fc-7086fecf7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efaf3a5-1b4f-46de-b8f4-29cd166d7d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efaf3a5-1b4f-46de-b8f4-29cd166d7d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4780686b-b8a7-4f57-ad34-720892e9cd9e', 'volume_name': 'volume-4780686b-b8a7-4f57-ad34-720892e9cd9e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0c046-1824-479f-ae06-14354464b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0c046-1824-479f-ae06-14354464b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a71e92-d79b-48ab-8fe4-85271205e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume 4780686b-b8a7-4f57-ad34-720892e9cd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4780686b-b8a7-4f57-ad34-720892e9cd9e', 'volume_size': 1}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:59 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 1073741824" returned: 0 in 0.468s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:21:59 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175
Sep 25 17:21:59 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:21:59 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175" returned: 0 in 0.232s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791142344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0737c4-d987-429b-afe8-b184b5743148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:57Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume aa0737c4-d987-429b-afe8-b184b5743148 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:21:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:21:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ded9de-1cc1-4998-b658-dc22e0ec5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77edef9-973e-45f8-871d-74bc2c13f175', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:00 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 1073741824
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cee156b-ba79-42f7-a88d-850bdcb17ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:00 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Volume volume-e77edef9-973e-45f8-871d-74bc2c13f175 (e77edef9-973e-45f8-871d-74bc2c13f175): created successfully
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cee156b-ba79-42f7-a88d-850bdcb17ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Flow 'volume_create_manager' (e18126fa-613b-4e0d-a930-9b5891e50db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ac23e27d-96fd-480b-b27a-958f219fc319 tempest-CinderUnicodeTest-1220636739 None] Created volume successfully.
Sep 25 17:22:00 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 1073741824" returned: 0 in 0.406s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:00 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148
Sep 25 17:22:00 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:00 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148" returned: 0 in 0.232s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.034s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324474867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0355df45-bf30-4c47-b26d-08983a2d3690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a297c82043ea4693b1aa66fa23878a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:57Z,use_quota=True,user_id='5073c4bf9d0b445eb7d1398946678bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Creating volume 0355df45-bf30-4c47-b26d-08983a2d3690 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:00 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 1073741824
Sep 25 17:22:00 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236e4178-60a7-4181-83cf-b9a2870f19c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0737c4-d987-429b-afe8-b184b5743148', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3f2f5c-eeac-4feb-a1c4-00a30676e725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-aa0737c4-d987-429b-afe8-b184b5743148 (aa0737c4-d987-429b-afe8-b184b5743148): created successfully
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3f2f5c-eeac-4feb-a1c4-00a30676e725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (81623495-cdc6-4631-adbf-5ea946bbdc57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-371d2c74-6b4a-4adb-95b6-02e114f5bfee tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:22:01 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 1073741824" returned: 0 in 0.496s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:01 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690
Sep 25 17:22:01 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:01 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690" returned: 0 in 0.243s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.823s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d398388-3105-4d17-8295-57d31ccd4c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651dbf01ee0a4143a95366dcdfeb6085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:50Z,use_quota=True,user_id='b580d9fee5034b808a30c5a5b92d7dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ec092be-8378-480a-a211-0118bb6dca3d),volume_type_id=9ec092be-8378-480a-a211-0118bb6dca3d)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Creating volume 0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c652436-8571-455e-a073-770e8fb2266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0355df45-bf30-4c47-b26d-08983a2d3690', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:01 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1073741824
Sep 25 17:22:01 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c1350-ea61-4eba-a032-ba2e75a15a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Volume volume-0355df45-bf30-4c47-b26d-08983a2d3690 (0355df45-bf30-4c47-b26d-08983a2d3690): created successfully
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c1350-ea61-4eba-a032-ba2e75a15a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Flow 'volume_create_manager' (0b41b6f3-442e-42af-8190-25b6ed2a7635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e69cbfd-893a-4129-b49f-10de377dde6e tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created volume successfully.
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-aa0737c4-d987-429b-afe8-b184b5743148-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-aa0737c4-d987-429b-afe8-b184b5743148-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-aa0737c4-d987-429b-afe8-b184b5743148" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-aa0737c4-d987-429b-afe8-b184b5743148" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0268ef83-0612-40f3-93cc-d148d0c3ba9b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:01 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1073741824" returned: 0 in 0.492s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12
Sep 25 17:22:02 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148
Sep 25 17:22:02 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12" returned: 0 in 0.243s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.372s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145363421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b9439-86c6-4fd1-892a-d9c283bdcd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:58Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume 976b9439-86c6-4fd1-892a-d9c283bdcd8b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:02 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b 1073741824
Sep 25 17:22:02 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Attempting download of 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}])) to volume 0d398388-3105-4d17-8295-57d31ccd4c12. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:22:02 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0460eeaf-9137-4856-ab8e-5b7a48feb241]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148
Sep 25 17:22:02 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49
Sep 25 17:22:02 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-aa0737c4-d987-429b-afe8-b184b5743148" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-aa0737c4-d987-429b-afe8-b184b5743148" released by "delete_volume" :: held 0.699s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['425b4ef0-b229-4ed8-ba1b-76af29ee542a', 'fd649d10-8bfa-49fc-99f2-4657ff54e956', '41fe5fcb-7696-41ce-ae85-a5dafec9e29b', '452511fc-ef9b-4120-9fd6-f03d437cfa27'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:02 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49" returned: 0 in 0.366s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b 1073741824" returned: 0 in 0.517s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49
Sep 25 17:22:02 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:02 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:02 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b
Sep 25 17:22:02 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-0355df45-bf30-4c47-b26d-08983a2d3690-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-0355df45-bf30-4c47-b26d-08983a2d3690-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-0355df45-bf30-4c47-b26d-08983a2d3690" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:03 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-0355df45-bf30-4c47-b26d-08983a2d3690" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:03 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49" returned: 1 in 0.422s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_ennwle49' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b" returned: 0 in 0.300s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb22296-25a6-46e4-a5fa-d65ba6ae1fb1]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.821s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040223632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d934d1e-7c0d-46df-8c96-90d6e35787bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:58Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume 0d934d1e-7c0d-46df-8c96-90d6e35787bc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:03 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d0695-84d5-4b53-bc8b-44204b877d44]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:03 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc 1073741824
Sep 25 17:22:03 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d109f608-04dd-49de-9efe-c14e3130b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6989492b-92e7-4c9e-8322-4d5269466c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b (976b9439-86c6-4fd1-892a-d9c283bdcd8b): created successfully
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6989492b-92e7-4c9e-8322-4d5269466c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (6a22fa66-8d5a-4e0d-8880-ffb99d196837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e8843b5-42a6-4839-ab9d-b407940d1116 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-aa0737c4-d987-429b-afe8-b184b5743148-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1ba5d9f7-2c6d-41d9-a6e6-b1f345d31f0c tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:22:03 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:22:03 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690
Sep 25 17:22:03 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:03 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD
Sep 25 17:22:03 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690" returned: 0 in 0.493s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690
Sep 25 17:22:03 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc 1073741824" returned: 0 in 0.567s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc
Sep 25 17:22:03 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:03 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.296s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:22:03 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 was raw, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:22:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:03 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12
Sep 25 17:22:03 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:04 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0355df45-bf30-4c47-b26d-08983a2d3690" returned: 0 in 0.340s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc" returned: 0 in 0.278s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-0355df45-bf30-4c47-b26d-08983a2d3690" released by "delete_volume" :: held 0.939s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.345s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736770036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:04 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162d8cbe-8378-40d8-9351-68985712d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:04 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 1073741824
Sep 25 17:22:04 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3befd0f-7307-45e7-ac1b-834582318f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc (0d934d1e-7c0d-46df-8c96-90d6e35787bc): created successfully
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3befd0f-7307-45e7-ac1b-834582318f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (4aaedd9c-13a4-46e2-8b01-72b4e407766c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fcb36228-2942-4a58-ac1a-5c891276b2cd tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['6f90fec0-0c95-4aff-8c1d-2ad768535cac', 'e7d6509c-b9d3-48c4-9ca6-fbb22ad6121b', '9b675876-4f22-4ff3-ae50-36d5b39a307f', 'bd7e3891-6088-459e-8e6b-9167136d5db4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:04 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:04 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:04 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12" returned: 0 in 0.549s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4_gx5emz95devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:22:04 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:04 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1G
Sep 25 17:22:04 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:04 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.295s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:04 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-709fc0c9-6e46-4051-bd0c-28ed94bf5636 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-0355df45-bf30-4c47-b26d-08983a2d3690-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 1073741824" returned: 0 in 0.573s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:04 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33
Sep 25 17:22:04 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:04 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 1G" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Downloaded image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}])) to volume 0d398388-3105-4d17-8295-57d31ccd4c12 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Temporary image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 for user b580d9fee5034b808a30c5a5b92d7dbc is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Marking volume 0d398388-3105-4d17-8295-57d31ccd4c12 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Copying metadata from image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 to 0d398388-3105-4d17-8295-57d31ccd4c12. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Creating volume glance metadata for volume 0d398388-3105-4d17-8295-57d31ccd4c12 backed by image 71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fa50e3c157a95333def3bac45b191871', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:22:04 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.859s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923221443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e2e401-5682-417f-b07f-021ab1c949c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume 87e2e401-5682-417f-b07f-021ab1c949c2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:05 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 1073741824
Sep 25 17:22:05 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6950e4-16aa-4137-9fac-fa063bf2c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66718482-60b0-4378-90fa-5d0b1ee9e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71de5ce9-7bf5-4a69-bd0c-0f2e4bad91d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d398388-3105-4d17-8295-57d31ccd4c12', 'volume_size': 1, 'image_id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fa50e3c157a95333def3bac45b191871', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '651dbf01ee0a4143a95366dcdfeb6085', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99c48f5b4e7921a47976b7362adefb59e8581f63e70a61555680dcc74c4f75e630433835fc9d31dc34f6a8b4d95c1e88de69973cc2629312e4dfe22687987ed4', 'id': '71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4', 'created_at': datetime.datetime(2026, 9, 25, 15, 21, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 21, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71d8ba6d-cbb9-4fa9-8dfe-27befa7745a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48ab8fe00>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e177362-95cc-4ee1-95c8-2f113232e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 (e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33): created successfully
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66718482-60b0-4378-90fa-5d0b1ee9e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (e19a6f3f-a18d-42a4-a370-4fec8f5fb6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Volume volume-0d398388-3105-4d17-8295-57d31ccd4c12 (0d398388-3105-4d17-8295-57d31ccd4c12): created successfully
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e177362-95cc-4ee1-95c8-2f113232e12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Flow 'volume_create_manager' (ba83d516-bf95-47b7-a83b-befee16450b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b828348d-6926-4c13-b4f6-68d9e79b3365 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f01498b0-0594-4bed-8e67-ef46dd3d2724 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Created volume successfully.
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-e1f10789-3f3b-48a9-969c-e8cd7dfa1757-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-e1f10789-3f3b-48a9-969c-e8cd7dfa1757-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d14bb3-4d50-44c5-829c-4aa055b94e03]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:05 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 1073741824" returned: 0 in 0.541s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:05 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757
Sep 25 17:22:05 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:05 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2
Sep 25 17:22:05 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Acquiring lock "cinder-0d398388-3105-4d17-8295-57d31ccd4c12-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "cinder-0d398388-3105-4d17-8295-57d31ccd4c12-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Acquiring lock "cinder-quobyte-0d398388-3105-4d17-8295-57d31ccd4c12" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "cinder-quobyte-0d398388-3105-4d17-8295-57d31ccd4c12" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:05 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:05 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" returned: 0 in 0.512s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[33200446-5818-4e7e-9a3c-fd66af5ba193]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:05 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:05 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.371s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820082313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4780686b-b8a7-4f57-ad34-720892e9cd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a7ae3cd8bf4b7b938189afac390f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:21:59Z,use_quota=True,user_id='8afd8b0f471c4503827c4a7807c4eb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Creating volume 4780686b-b8a7-4f57-ad34-720892e9cd9e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214e6a33-c16b-4e7c-9258-e1d8f1c2afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e2e401-5682-417f-b07f-021ab1c949c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:06 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e 1073741824
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cd6cbf-f611-4cc5-b7f2-013d7820ac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:06 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-87e2e401-5682-417f-b07f-021ab1c949c2 (87e2e401-5682-417f-b07f-021ab1c949c2): created successfully
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cd6cbf-f611-4cc5-b7f2-013d7820ac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (58a63251-df59-4a6a-846c-3b83074bdcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b4610872-ff42-4083-b0a3-05b3f34d90b4 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:22:06 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12
Sep 25 17:22:06 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-e1f10789-3f3b-48a9-969c-e8cd7dfa1757" released by "delete_volume" :: held 0.828s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['80efa66c-9da5-4712-aeeb-91bcc81c1b5c', 'f4aa4c41-7bc8-4226-9888-f4d8ce76bd55', 'ea243c20-4d15-4d3c-aee4-cd99faf316a0', '50018790-d366-4550-bea3-4afbeb2c4edb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:06 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:06 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12" returned: 0 in 0.504s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:06 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12
Sep 25 17:22:06 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-3d2234a7-326b-4f51-8736-9fcbaf108b4e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-3d2234a7-326b-4f51-8736-9fcbaf108b4e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:06 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e 1073741824" returned: 0 in 0.590s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-3d2234a7-326b-4f51-8736-9fcbaf108b4e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-3d2234a7-326b-4f51-8736-9fcbaf108b4e" acquired by "delete_volume" :: waited 0.081s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:06 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e
Sep 25 17:22:06 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b399ddd-0906-4df2-895b-6c2579b525fa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:06 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:06 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8442218e-b22a-44d4-b871-eb19d3233551 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-e1f10789-3f3b-48a9-969c-e8cd7dfa1757-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d398388-3105-4d17-8295-57d31ccd4c12" returned: 0 in 0.352s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "cinder-quobyte-0d398388-3105-4d17-8295-57d31ccd4c12" released by "delete_volume" :: held 0.925s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Created reservations ['4cd6a0c3-2910-43a6-bdf6-b327aa0fd94c', '572bcff7-25f3-497b-aa94-d27a58bb477d', '153e9faa-dbb7-49f1-91ab-190388cd0a23', '070a4934-fa03-4cec-bd7c-3cf74f92b413'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:06 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e
Sep 25 17:22:06 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:07 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:07 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:07 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e" returned: 0 in 0.405s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.895s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a71e92-d79b-48ab-8fe4-85271205e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4780686b-b8a7-4f57-ad34-720892e9cd9e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e94abaf-742a-4283-b926-ee6f2b21a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Creating offline snapshot 9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 of volume e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:22:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Volume volume-4780686b-b8a7-4f57-ad34-720892e9cd9e (4780686b-b8a7-4f57-ad34-720892e9cd9e): created successfully
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e94abaf-742a-4283-b926-ee6f2b21a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Flow 'volume_create_manager' (6da034a9-576e-4bc5-aacb-d3f45b300d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ceaae0-b458-45f2-8707-bfe964562017]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9e0c42ef-585c-4dbe-9417-2f63c8e71d45 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created volume successfully.
Sep 25 17:22:07 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175
Sep 25 17:22:07 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:07 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e" returned: 0 in 0.616s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:07 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e
Sep 25 17:22:07 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:07 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.425s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Deleted volume successfully.
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d04a7cc0-65e5-4267-addf-462d12859599 tempest-VolumeAndVolumeTypeFromImageTest-1945406662 None] Lock "cinder-0d398388-3105-4d17-8295-57d31ccd4c12-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:07 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175" returned: 0 in 0.442s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:07 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 1G
Sep 25 17:22:07 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:07 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-3d2234a7-326b-4f51-8736-9fcbaf108b4e" returned: 0 in 0.329s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-3d2234a7-326b-4f51-8736-9fcbaf108b4e" released by "delete_volume" :: held 1.008s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['6daea7ec-e63e-4762-8421-11f164940ca6', '71914c42-3872-457b-8568-975e8dc20909', '4b6eec50-8c5e-4f51-ae09-613a436fff58', '71510300-abb2-4cc2-a218-b73ec9f872d6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:07 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:07 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:08 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 1G" returned: 0 in 0.490s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77edef9-973e-45f8-871d-74bc2c13f175 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77edef9-973e-45f8-871d-74bc2c13f175 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77
Sep 25 17:22:08 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:08 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5e18f66d-2770-4006-8ed0-e79a93e070ff tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-3d2234a7-326b-4f51-8736-9fcbaf108b4e-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-4780686b-b8a7-4f57-ad34-720892e9cd9e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-4780686b-b8a7-4f57-ad34-720892e9cd9e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-4780686b-b8a7-4f57-ad34-720892e9cd9e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-4780686b-b8a7-4f57-ad34-720892e9cd9e" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:08 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77edef9-973e-45f8-871d-74bc2c13f175 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" returned: 0 in 0.366s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:08 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 is being set with open permissions: ugo+rw
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c37201a-5efd-4249-86ac-6d05c5645018]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77
Sep 25 17:22:08 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:08 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e
Sep 25 17:22:08 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:08 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" returned: 0 in 0.311s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-474c553c-1f0c-43a3-a74c-a5896059bdc0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-474c553c-1f0c-43a3-a74c-a5896059bdc0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:08 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info
Sep 25 17:22:08 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-474c553c-1f0c-43a3-a74c-a5896059bdc0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-474c553c-1f0c-43a3-a74c-a5896059bdc0" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:08 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e" returned: 0 in 0.476s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[705bb4a5-4ec5-456b-b56a-4f1d63fb1b5c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:08 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e
Sep 25 17:22:08 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0
Sep 25 17:22:09 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info" returned: 0 in 0.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info is being set with open permissions: ugo+rw
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:09 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info
Sep 25 17:22:09 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4780686b-b8a7-4f57-ad34-720892e9cd9e" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-4780686b-b8a7-4f57-ad34-720892e9cd9e" released by "delete_volume" :: held 0.857s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['7f08837c-823f-4071-9032-e77fbfdca922', '0734fcdd-83a0-41b1-bba7-9dd99f44d622', '4e2065c1-dcd7-417d-8fc0-05a0ef4a1ae0', '1df16af9-047a-48c5-a4b2-8b07100e64a1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:09 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.info" returned: 0 in 0.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:09 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0" returned: 0 in 0.540s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:09 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0
Sep 25 17:22:09 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-87e2e401-5682-417f-b07f-021ab1c949c2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6c275789-6425-48cd-a571-979d1a7f904b tempest-CinderUnicodeTest-1220636739 None] Create snapshot completed successfully
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-87e2e401-5682-417f-b07f-021ab1c949c2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-87e2e401-5682-417f-b07f-021ab1c949c2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-87e2e401-5682-417f-b07f-021ab1c949c2" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6da5cf-30eb-45e8-a6dd-f77475e30b66]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:09 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b78ff321-3b4b-4872-bc09-5e994b53de09 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-4780686b-b8a7-4f57-ad34-720892e9cd9e-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:09 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2
Sep 25 17:22:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:09 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-474c553c-1f0c-43a3-a74c-a5896059bdc0" returned: 0 in 0.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-474c553c-1f0c-43a3-a74c-a5896059bdc0" released by "delete_volume" :: held 1.042s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['45fc76ca-29ec-4281-9aeb-94c9d52a0743', '4c6929b5-4503-4587-8b33-8f2506c35bc9', '81093001-65c4-4f74-9f6d-cdf93fe5e903', 'e8babed7-89ad-4e66-9015-84a34e60067f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:10 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:10 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:10 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2" returned: 0 in 0.464s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:10 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2
Sep 25 17:22:10 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:10 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-120a0e7c-de70-4ec3-bdc0-23b92e8268ab tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-474c553c-1f0c-43a3-a74c-a5896059bdc0-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:10 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-87e2e401-5682-417f-b07f-021ab1c949c2" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-87e2e401-5682-417f-b07f-021ab1c949c2" released by "delete_volume" :: held 0.842s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['a3e5da3e-0d2e-4c92-ba4e-4fef23d595cb', 'bbaa47ff-c5cb-4da9-a109-d16b03ccedcc', 'd5fc9892-f9b8-477b-a3a2-dee421b60d92', '74501c2c-9a68-4606-a4e7-0b458112d399'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-quobyte-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:10 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:10 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Deleting offline snapshot 9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 of volume e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] snapshot_file for this snap is: volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40c6c9-5bc1-4034-9588-3134dca91900]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:10 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77
Sep 25 17:22:10 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:11 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.336s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d0a07c-7933-4c4b-9207-c963ae1720a0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3b8d1a1e-e751-44ac-98ab-6745505e3cce tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-87e2e401-5682-417f-b07f-021ab1c949c2-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-c12ef295-9324-4c92-b7b9-fe04a1141de8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-c12ef295-9324-4c92-b7b9-fe04a1141de8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:11 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33
Sep 25 17:22:11 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "cinder-quobyte-c12ef295-9324-4c92-b7b9-fe04a1141de8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:11 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" returned: 0 in 0.496s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77edef9-973e-45f8-871d-74bc2c13f175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-c12ef295-9324-4c92-b7b9-fe04a1141de8" acquired by "delete_volume" :: waited 0.054s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f316d43-d345-4655-a4ca-eaa7ce450f03]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6238336f-fa77-4ae0-b7fd-7270a429b3ea]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175
Sep 25 17:22:11 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8
Sep 25 17:22:11 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" returned: 0 in 0.496s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33
Sep 25 17:22:11 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175" returned: 0 in 0.433s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77
Sep 25 17:22:11 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8" returned: 0 in 0.493s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" returned: 0 in 0.299s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:11 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33" released by "delete_volume" :: held 0.887s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:11 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['e0043463-d483-46fb-8140-aa68e82e4848', '4e2cc830-8ff3-495f-b860-49e707e1a51f', '37666a8d-e4f8-4dc4-806d-9c6fe70f3416', 'a48464a5-7b2d-42d3-9de6-57c0fe9b860c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:12 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:12 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:12 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c12ef295-9324-4c92-b7b9-fe04a1141de8" returned: 0 in 0.332s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-quobyte-c12ef295-9324-4c92-b7b9-fe04a1141de8" released by "delete_volume" :: held 0.884s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Created reservations ['4fd98370-8d53-41f1-b3c1-d6f859cb2d46', '8ce3353e-649b-4a21-8023-20ebf94cae79', 'd55b7a5c-4c69-4e61-bfca-78250041f501', '912630d7-021e-4ffa-b9d0-e52b2b41fa8a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:12 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" returned: 0 in 0.511s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:12 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77
Sep 25 17:22:12 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:12 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:12 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:12 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f096f1a-8849-417f-8a6e-96ec874a818f tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-e6cb2e7d-c65c-46d7-8082-d8e6d2c31e33-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:12 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175.9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" returned: 0 in 0.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77" released by "_delete_snapshot" :: held 1.912s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" released by "delete_snapshot" :: held 1.944s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:12 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.270s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Deleted volume successfully.
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d8d81ca5-1042-49f5-866d-7b632fd5e6b9 tempest-CreateVolumesFromSourceVolumeTest-753286615 None] Lock "cinder-c12ef295-9324-4c92-b7b9-fe04a1141de8-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Created reservations ['e4f4851c-62c4-48aa-b304-df6d21aa8366', '5efad7c2-1c22-4bcf-b602-03810102e143', '9da92133-04ed-48cc-83c7-f1a2b74caeab', '4a356bba-37cb-46fc-8b9d-f89222ae6d0e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Delete snapshot completed successfully.
Sep 25 17:22:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aae5d313-3554-4870-9b3d-d8bb29d31956 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-9fa0a99e-4f1a-4ded-84bc-a20c8c68eb77-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (72ffd06e-74e1-43b3-9b3f-108e14fc6826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cc3604-76d5-4c2e-8cb0-8c1663ae1f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cc3604-76d5-4c2e-8cb0-8c1663ae1f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765316178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ede2f5-57fb-47c6-9db3-0adab06ba8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:13Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7755a8-b713-4b2c-9969-1b24964f5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7755a8-b713-4b2c-9969-1b24964f5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1989884-1969-404e-b1ca-bd086170908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1989884-1969-404e-b1ca-bd086170908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ede2f5-57fb-47c6-9db3-0adab06ba8a2', 'volume_name': 'volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7850fc07-9671-4749-939c-b06d68edd293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7850fc07-9671-4749-939c-b06d68edd293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61fb338-ffa6-4720-a550-0e1c82659fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Volume 16ede2f5-57fb-47c6-9db3-0adab06ba8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2', 'volume_size': 1}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1765316178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ede2f5-57fb-47c6-9db3-0adab06ba8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:13Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Creating volume 16ede2f5-57fb-47c6-9db3-0adab06ba8a2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:13 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 1073741824
Sep 25 17:22:13 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-0d934d1e-7c0d-46df-8c96-90d6e35787bc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-0d934d1e-7c0d-46df-8c96-90d6e35787bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-0d934d1e-7c0d-46df-8c96-90d6e35787bc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-0d934d1e-7c0d-46df-8c96-90d6e35787bc" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb42dc2-4e8a-4ee4-8cb4-32aefee7f4bd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:13 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc
Sep 25 17:22:13 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (7f4263d5-dfd9-4686-8133-c7555abd11ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b969859-0a7b-4bd7-b7f7-ab04f5fcfe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b969859-0a7b-4bd7-b7f7-ab04f5fcfe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1105577812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9673deff-0a53-4464-8aed-f49b7c5530cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:13Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c53264-ab1c-4e2e-8b09-90d34a6eb096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c53264-ab1c-4e2e-8b09-90d34a6eb096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c0f6e9-1dc0-41d0-aa8c-497a810873c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c0f6e9-1dc0-41d0-aa8c-497a810873c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9673deff-0a53-4464-8aed-f49b7c5530cd', 'volume_name': 'volume-9673deff-0a53-4464-8aed-f49b7c5530cd', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb47f68-e4dc-41f1-8dc0-e5937094c0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb47f68-e4dc-41f1-8dc0-e5937094c0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca9bd9e-20b5-42da-9f86-e29e3d9d401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Volume 9673deff-0a53-4464-8aed-f49b7c5530cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9673deff-0a53-4464-8aed-f49b7c5530cd', 'volume_size': 1}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:13 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 1073741824" returned: 0 in 0.692s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:13 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc" returned: 0 in 0.523s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:13 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc
Sep 25 17:22:13 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-e77edef9-973e-45f8-871d-74bc2c13f175-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:13 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2
Sep 25 17:22:13 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-e77edef9-973e-45f8-871d-74bc2c13f175-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:13 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (77bbcfb7-2bb6-44e8-bcb7-d4c11b1d0902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73819c1-b82c-49fc-b2a4-ea861e964796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73819c1-b82c-49fc-b2a4-ea861e964796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029943992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7d2e89-7192-42b5-bb57-85c1a1a451af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:14Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b9708-7230-4c78-8523-5ca0df9084cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b9708-7230-4c78-8523-5ca0df9084cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed775878-7936-41d3-9cd3-757e1c092786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed775878-7936-41d3-9cd3-757e1c092786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7d2e89-7192-42b5-bb57-85c1a1a451af', 'volume_name': 'volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5857702-8757-45bb-b81d-43feac90fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5857702-8757-45bb-b81d-43feac90fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f1bb82-19df-40ca-a604-25d89ae235a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Volume 4c7d2e89-7192-42b5-bb57-85c1a1a451af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af', 'volume_size': 1}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:14 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0d934d1e-7c0d-46df-8c96-90d6e35787bc" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a7287-2a72-4429-8db3-06ed98325414]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-0d934d1e-7c0d-46df-8c96-90d6e35787bc" released by "delete_volume" :: held 1.043s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['1ce53606-aef1-4a92-98b7-caa558b9106d', 'c91b9fec-5a64-4bca-bf8b-aa5febaffe38', '6b8b4b66-c419-4576-b59d-980fa8f38340', '2c33e1d0-a269-4c2e-9596-1191efcc45d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:14 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175
Sep 25 17:22:14 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:14 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" returned: 0 in 0.614s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1105577812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9673deff-0a53-4464-8aed-f49b7c5530cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:13Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Creating volume 9673deff-0a53-4464-8aed-f49b7c5530cd {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:14 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd 1073741824
Sep 25 17:22:14 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61fb338-ffa6-4720-a550-0e1c82659fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305a0052-cc45-4b6a-825b-b5bb757772c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Volume volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 (16ede2f5-57fb-47c6-9db3-0adab06ba8a2): created successfully
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305a0052-cc45-4b6a-825b-b5bb757772c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (72ffd06e-74e1-43b3-9b3f-108e14fc6826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b31f6c1f-3462-44ca-8c1e-c1080bf56f51 tempest-CreateVolumesFromImageTest-360582174 None] Created volume successfully.
Sep 25 17:22:14 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:14 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (be6fdb32-fe64-4268-980b-e9ce8064679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5882cf0a-40dc-4183-b09f-10edd50ae532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5882cf0a-40dc-4183-b09f-10edd50ae532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962713643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc85609-3f7f-4252-8afa-b62e2013e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:15Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57795ae-7bff-4416-8434-fb68c1a92c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57795ae-7bff-4416-8434-fb68c1a92c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d981cef-46ff-4c90-b753-bb9cd0425d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d981cef-46ff-4c90-b753-bb9cd0425d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc85609-3f7f-4252-8afa-b62e2013e4f9', 'volume_name': 'volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964f32bd-ff4c-44ca-ad05-517fa20735f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964f32bd-ff4c-44ca-ad05-517fa20735f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5dd96-a2cd-4470-9647-1f6e77bd7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Volume 4cc85609-3f7f-4252-8afa-b62e2013e4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9', 'volume_size': 1}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:15 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175" returned: 0 in 0.967s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:15 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175
Sep 25 17:22:15 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:15 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.634s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a744a5bc-5b5f-4ab6-90ef-ab0579dd2654 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-0d934d1e-7c0d-46df-8c96-90d6e35787bc-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:15 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (e5f941cb-4372-401c-b130-937d6512c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba93bbd-11e6-4451-afc1-345df8a8b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd 1073741824" returned: 0 in 0.952s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-976b9439-86c6-4fd1-892a-d9c283bdcd8b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba93bbd-11e6-4451-afc1-345df8a8b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832684766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b40198f-a301-4019-85de-0a9d39a1f2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:15Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6fa536-d419-47dc-99dc-4444e61ec1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6fa536-d419-47dc-99dc-4444e61ec1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25148b6b-1ad6-4d70-af99-e7cb079fd3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25148b6b-1ad6-4d70-af99-e7cb079fd3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b40198f-a301-4019-85de-0a9d39a1f2e5', 'volume_name': 'volume-0b40198f-a301-4019-85de-0a9d39a1f2e5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a89924-1cec-4380-acb8-a823581ac1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a89924-1cec-4380-acb8-a823581ac1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9bfe8-876e-438e-92a7-41a7c99ddf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Volume 0b40198f-a301-4019-85de-0a9d39a1f2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b40198f-a301-4019-85de-0a9d39a1f2e5', 'volume_size': 1}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:15 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-976b9439-86c6-4fd1-892a-d9c283bdcd8b-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-e77edef9-973e-45f8-871d-74bc2c13f175" returned: 0 in 0.367s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-e77edef9-973e-45f8-871d-74bc2c13f175" released by "delete_volume" :: held 1.469s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:15 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd
Sep 25 17:22:15 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-976b9439-86c6-4fd1-892a-d9c283bdcd8b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-976b9439-86c6-4fd1-892a-d9c283bdcd8b" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad44c4b6-bc14-40d9-aea2-05c03cd4f23b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Created reservations ['27ad734f-be3c-4664-9331-90531856280a', '0542f059-3d9f-48c5-ae15-199787147435', '02c2ec7a-38e1-4e5e-9f9e-0fa92aa08227', 'd9fe0cef-ee96-4bfb-8429-0e565dd66a2b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:15 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b
Sep 25 17:22:15 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:15 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:15 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:15 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029943992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7d2e89-7192-42b5-bb57-85c1a1a451af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:14Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Creating volume 4c7d2e89-7192-42b5-bb57-85c1a1a451af {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca9bd9e-20b5-42da-9f86-e29e3d9d401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9673deff-0a53-4464-8aed-f49b7c5530cd', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:16 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af 1073741824
Sep 25 17:22:16 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbbe954-c4be-4c7f-a4e4-e9385d4b9ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Volume volume-9673deff-0a53-4464-8aed-f49b7c5530cd (9673deff-0a53-4464-8aed-f49b7c5530cd): created successfully
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbbe954-c4be-4c7f-a4e4-e9385d4b9ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (7f4263d5-dfd9-4686-8133-c7555abd11ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-61eb47d0-15de-4c63-bc48-75913c8bcec4 tempest-CreateVolumesFromImageTest-360582174 None] Created volume successfully.
Sep 25 17:22:16 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b" returned: 0 in 0.492s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.348s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Deleted volume successfully.
Sep 25 17:22:16 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b
Sep 25 17:22:16 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50291977-b2ed-4bce-9ec1-adf4d8174f1e tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-e77edef9-973e-45f8-871d-74bc2c13f175-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-79a6c843-a1e1-48b6-b315-b4c49fadc73f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-79a6c843-a1e1-48b6-b315-b4c49fadc73f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "cinder-quobyte-79a6c843-a1e1-48b6-b315-b4c49fadc73f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-79a6c843-a1e1-48b6-b315-b4c49fadc73f" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2410dda-9fb9-400a-965a-6e0005ee2f29]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-976b9439-86c6-4fd1-892a-d9c283bdcd8b" returned: 0 in 0.361s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-976b9439-86c6-4fd1-892a-d9c283bdcd8b" released by "delete_volume" :: held 0.921s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:16 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f
Sep 25 17:22:16 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['2aa1b21b-fb73-4e7b-8dad-a8491f8f64fc', '39d6c0e9-99e4-4f2f-8b5e-477abb401ffa', '3d11a22e-55f1-41f0-aab3-206d78061be3', 'e3bc2161-7599-4dac-a25e-33010a8a22ac'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:16 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af 1073741824" returned: 0 in 0.725s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af
Sep 25 17:22:16 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:16 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:16 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:16 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f" returned: 0 in 0.428s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:16 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f
Sep 25 17:22:16 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:17 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af" returned: 0 in 0.258s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-962713643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc85609-3f7f-4252-8afa-b62e2013e4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:15Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Creating volume 4cc85609-3f7f-4252-8afa-b62e2013e4f9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f1bb82-19df-40ca-a604-25d89ae235a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:17 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 1073741824
Sep 25 17:22:17 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fd7256-818e-40fe-adba-0ae157626fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:17 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.291s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Volume volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af (4c7d2e89-7192-42b5-bb57-85c1a1a451af): created successfully
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90fd7256-818e-40fe-adba-0ae157626fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (77bbcfb7-2bb6-44e8-bcb7-d4c11b1d0902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cfff391f-598d-4824-b01d-d11befa8280c tempest-CreateVolumesFromImageTest-360582174 None] Created volume successfully.
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-55c76cf7-69e8-45b9-bff1-8595e7cd04a7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-976b9439-86c6-4fd1-892a-d9c283bdcd8b-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:17 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-79a6c843-a1e1-48b6-b315-b4c49fadc73f" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-quobyte-79a6c843-a1e1-48b6-b315-b4c49fadc73f" released by "delete_volume" :: held 0.757s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Created reservations ['7f317ae9-2eeb-4c25-a0ca-84291ef28382', '3d52c2d6-ff94-42d9-84cb-e86ffddccf6c', 'ab529ddc-19bd-47dd-a591-bacb3baacb20', 'd300d127-2aee-4a3b-a41f-c61c668a9fe1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:17 devstack sudo[107101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:17 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:17 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 1073741824" returned: 0 in 0.469s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:17 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9
Sep 25 17:22:17 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:17 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.278s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Deleted volume successfully.
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4db379a-a50b-4028-8f0e-860cd9cb0455 tempest-CinderUnicodeTest-1220636739 None] Lock "cinder-79a6c843-a1e1-48b6-b315-b4c49fadc73f-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-c549bcb5-b090-4cc9-9004-b09a58d920f0-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-c549bcb5-b090-4cc9-9004-b09a58d920f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-c549bcb5-b090-4cc9-9004-b09a58d920f0" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-c549bcb5-b090-4cc9-9004-b09a58d920f0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:17 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleting offline snapshot c549bcb5-b090-4cc9-9004-b09a58d920f0 of volume 784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] snapshot_file for this snap is: volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.333s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1832684766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b40198f-a301-4019-85de-0a9d39a1f2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7bd0357c614a43a4ec82c253c2fe5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:15Z,use_quota=True,user_id='1c462499cd1d45d2a92904a61860778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Creating volume 0b40198f-a301-4019-85de-0a9d39a1f2e5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:17 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b299e078-1eef-4186-9856-7d6243e01d56]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:17 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 1073741824
Sep 25 17:22:17 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5dd96-a2cd-4470-9647-1f6e77bd7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919cdd5f-4fa1-4c5a-b503-b9b8d803828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Volume volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 (4cc85609-3f7f-4252-8afa-b62e2013e4f9): created successfully
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919cdd5f-4fa1-4c5a-b503-b9b8d803828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (be6fdb32-fe64-4268-980b-e9ce8064679d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ee7f977b-e66b-4502-ac84-17988eccfe46 tempest-CreateVolumesFromImageTest-360582174 None] Created volume successfully.
Sep 25 17:22:18 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0
Sep 25 17:22:18 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:18 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0" returned: 0 in 0.440s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-784582fd-9a09-4ff1-a167-e0e39a538f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa3cdf-fe86-4685-bd46-c23693c1fcee]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:18 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 1073741824" returned: 0 in 0.515s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:18 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5
Sep 25 17:22:18 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:18 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d
Sep 25 17:22:18 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:18 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5" returned: 0 in 0.286s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9bfe8-876e-438e-92a7-41a7c99ddf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b40198f-a301-4019-85de-0a9d39a1f2e5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc50fbd-da4d-4930-8949-517fece9abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Volume volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 (0b40198f-a301-4019-85de-0a9d39a1f2e5): created successfully
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc50fbd-da4d-4930-8949-517fece9abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Flow 'volume_create_manager' (e5f941cb-4372-401c-b130-937d6512c25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3f341510-b25e-4fc5-bff6-be0c493e8ed5 tempest-CreateVolumesFromImageTest-360582174 None] Created volume successfully.
Sep 25 17:22:18 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d" returned: 0 in 0.472s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:18 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0
Sep 25 17:22:18 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:19 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0" returned: 0 in 0.393s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:19 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0
Sep 25 17:22:19 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:19 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d.c549bcb5-b090-4cc9-9004-b09a58d920f0" returned: 0 in 0.259s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-c549bcb5-b090-4cc9-9004-b09a58d920f0" released by "_delete_snapshot" :: held 1.739s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" released by "delete_snapshot" :: held 1.768s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['1f88f607-9073-4d0f-9d39-539febf4acfb', '83d183a2-6b34-481e-9c79-873762d812ed', '1082cb4a-d056-496e-8b77-b23ef485dc7f', '241084b0-d995-4241-a18a-76483ee2af6e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Delete snapshot completed successfully.
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4c8cc65-d1f0-4b7b-b8a5-5bbb106544b7 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-c549bcb5-b090-4cc9-9004-b09a58d920f0-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-784582fd-9a09-4ff1-a167-e0e39a538f0d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-0b40198f-a301-4019-85de-0a9d39a1f2e5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-784582fd-9a09-4ff1-a167-e0e39a538f0d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-0b40198f-a301-4019-85de-0a9d39a1f2e5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-quobyte-0b40198f-a301-4019-85de-0a9d39a1f2e5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d97dbd-c59e-4435-9a6d-3b9c212c7a69]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-0b40198f-a301-4019-85de-0a9d39a1f2e5" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc4ec4-83f1-48f8-adee-c6f64c36f919]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:20 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d
Sep 25 17:22:20 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:20 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5
Sep 25 17:22:20 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:20 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d" returned: 0 in 0.399s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:20 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d
Sep 25 17:22:20 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:20 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5" returned: 0 in 0.395s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:20 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5
Sep 25 17:22:20 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:20 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-784582fd-9a09-4ff1-a167-e0e39a538f0d" returned: 0 in 0.304s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:20 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0b40198f-a301-4019-85de-0a9d39a1f2e5" returned: 0 in 0.274s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-quobyte-784582fd-9a09-4ff1-a167-e0e39a538f0d" released by "delete_volume" :: held 0.792s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-0b40198f-a301-4019-85de-0a9d39a1f2e5" released by "delete_volume" :: held 0.723s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Created reservations ['88338ad0-ebc2-48ad-8959-cfb691f82ff4', 'c95bed17-b9fc-4247-9777-ca7c43609523', '0980e28d-0a57-4edf-9598-b273d2a75dba', '0132eea9-a77d-4930-86fb-f368ffcbf447'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Created reservations ['abbcc384-d2d4-447f-859b-e05c0c77d5be', 'f56c50cf-2c18-4dd8-99b6-a3e457dcfc3b', '4ecc22ee-0b5f-4290-b895-0e828731af6f', '701ba431-19d4-44d3-9c73-9ccb5de4a7e2'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:21 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:21 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:21 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:21 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-4cc85609-3f7f-4252-8afa-b62e2013e4f9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-4cc85609-3f7f-4252-8afa-b62e2013e4f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-quobyte-4cc85609-3f7f-4252-8afa-b62e2013e4f9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-4cc85609-3f7f-4252-8afa-b62e2013e4f9" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:21 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Deleted volume successfully.
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a4436-c422-490a-a3bc-7e72bfa68bd4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0570e7cf-4f16-4f88-afda-9650a23cd953 tempest-CreateVolumesFromSnapshotTest-1545101417 None] Lock "cinder-784582fd-9a09-4ff1-a167-e0e39a538f0d-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:21 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Deleted volume successfully.
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-98733405-b277-434b-8da6-9a2681a7515b tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-0b40198f-a301-4019-85de-0a9d39a1f2e5-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:21 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9
Sep 25 17:22:21 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:21 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9" returned: 0 in 0.449s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:21 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9
Sep 25 17:22:21 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:22 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4cc85609-3f7f-4252-8afa-b62e2013e4f9" returned: 0 in 0.320s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-4cc85609-3f7f-4252-8afa-b62e2013e4f9" released by "delete_volume" :: held 0.850s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Created reservations ['46a04d8b-6af2-42dd-b375-f6a3b1c517a0', '67314541-a61f-4880-a05b-94861f331b8f', '24d5c31a-0608-49a7-97e7-1cb4be7268f4', '2484d976-2eb9-4bf7-8691-9336d3af1462'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:22 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:22 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-4c7d2e89-7192-42b5-bb57-85c1a1a451af-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-4c7d2e89-7192-42b5-bb57-85c1a1a451af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-quobyte-4c7d2e89-7192-42b5-bb57-85c1a1a451af" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-4c7d2e89-7192-42b5-bb57-85c1a1a451af" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70cd2d0-58c2-4f6e-929a-bd2b2cc67e29]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:22 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.368s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Deleted volume successfully.
Sep 25 17:22:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3df8f919-2826-4f69-b431-22dfbd2ce952 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-4cc85609-3f7f-4252-8afa-b62e2013e4f9-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:22 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af
Sep 25 17:22:22 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:23 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af" returned: 0 in 0.487s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:23 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af
Sep 25 17:22:23 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:23 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4c7d2e89-7192-42b5-bb57-85c1a1a451af" returned: 0 in 0.306s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-4c7d2e89-7192-42b5-bb57-85c1a1a451af" released by "delete_volume" :: held 0.846s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Created reservations ['9af3ddd7-18db-41cb-ac3e-ae7dff5ec771', 'e6539e00-7d73-4956-986a-1d62ea415604', '043bd89d-d1c0-41a3-b108-59f258e70bdb', 'cac5f6eb-0a6c-48d5-b486-f2bf4adda280'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:23 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:23 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-9673deff-0a53-4464-8aed-f49b7c5530cd-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-9673deff-0a53-4464-8aed-f49b7c5530cd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-quobyte-9673deff-0a53-4464-8aed-f49b7c5530cd" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-9673deff-0a53-4464-8aed-f49b7c5530cd" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79b5c4d-e5e2-4e3c-b538-50cae975d13d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:23 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.349s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Deleted volume successfully.
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ea1256e-b2ec-4eec-b4ba-e2a8bff00153 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-4c7d2e89-7192-42b5-bb57-85c1a1a451af-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:24 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd
Sep 25 17:22:24 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:24 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd" returned: 0 in 0.419s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:24 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd
Sep 25 17:22:24 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:24 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9673deff-0a53-4464-8aed-f49b7c5530cd" returned: 0 in 0.314s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-9673deff-0a53-4464-8aed-f49b7c5530cd" released by "delete_volume" :: held 0.799s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Created reservations ['3bcdc467-81a3-4877-8c19-22b3d1608b1e', 'bff97b1a-3664-4f05-8859-29bd7f23f59a', 'ca3d9a22-0bb1-41b8-afcd-8c969903cd4d', '5199f604-ea65-4e37-9fd7-a100fb64ef8f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:24 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:24 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-16ede2f5-57fb-47c6-9db3-0adab06ba8a2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-16ede2f5-57fb-47c6-9db3-0adab06ba8a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "cinder-quobyte-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a37aa9a-ab2e-44b5-8e8d-80653df4fe75]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:25 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Deleted volume successfully.
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3250488-e0f7-4971-aac5-9031000303f3 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-9673deff-0a53-4464-8aed-f49b7c5530cd-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:25 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2
Sep 25 17:22:25 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Flow 'volume_create_manager' (7a064eb7-79c7-4d2b-87c3-191acc5ce02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542adb35-9610-43f0-9094-2122548a099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542adb35-9610-43f0-9094-2122548a099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1727180005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e897a82-61fb-4559-884c-ab9d6f9e2182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc9fd93294342feacfaf6b4ce666a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:25Z,use_quota=True,user_id='d652967e88334351b3ed77f2965a8bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddeaec2-9594-4412-9c9c-38d62fd3918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddeaec2-9594-4412-9c9c-38d62fd3918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ea8ca4-885b-4fb1-83ff-3a81b28f6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ea8ca4-885b-4fb1-83ff-3a81b28f6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e897a82-61fb-4559-884c-ab9d6f9e2182', 'volume_name': 'volume-4e897a82-61fb-4559-884c-ab9d6f9e2182', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d84b1-8d94-465c-b3ab-c8ae8b9e61a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d84b1-8d94-465c-b3ab-c8ae8b9e61a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5706864-6c2e-42ea-b217-21623cceb1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Volume 4e897a82-61fb-4559-884c-ab9d6f9e2182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e897a82-61fb-4559-884c-ab9d6f9e2182', 'volume_size': 1}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1727180005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e897a82-61fb-4559-884c-ab9d6f9e2182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc9fd93294342feacfaf6b4ce666a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:25Z,use_quota=True,user_id='d652967e88334351b3ed77f2965a8bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Creating volume 4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:25 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 1073741824
Sep 25 17:22:25 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:25 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" returned: 0 in 0.434s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:25 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2
Sep 25 17:22:25 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:25 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" returned: 0 in 0.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-quobyte-16ede2f5-57fb-47c6-9db3-0adab06ba8a2" released by "delete_volume" :: held 0.797s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Created reservations ['e9a04fbf-e089-4fa8-a670-e75fa4201d10', 'ec58d623-c4f8-4509-8026-35ae0805b86c', '38b0d48b-5718-4b11-a9d2-c58a6a470b20', '70e0250a-19c0-46fd-bdde-6e852e1f7163'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:25 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 1073741824" returned: 0 in 0.550s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:26 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:26 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:26 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:26 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:26 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Deleted volume successfully.
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c5bced6f-0595-46c0-82a1-888b10cf55c5 tempest-CreateVolumesFromImageTest-360582174 None] Lock "cinder-16ede2f5-57fb-47c6-9db3-0adab06ba8a2-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:26 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5706864-6c2e-42ea-b217-21623cceb1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e897a82-61fb-4559-884c-ab9d6f9e2182', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011ecfd-91b9-4532-9e29-a1cd7eb4ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Volume volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 (4e897a82-61fb-4559-884c-ab9d6f9e2182): created successfully
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011ecfd-91b9-4532-9e29-a1cd7eb4ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Flow 'volume_create_manager' (7a064eb7-79c7-4d2b-87c3-191acc5ce02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12d06d49-7b3d-4a28-86dc-6fba0344951c tempest-VolumeDependencyTests-1988963940 None] Created volume successfully.
Sep 25 17:22:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Creating offline snapshot 2bc4d6f0-264c-4e92-9493-02fdc3e05e08 of volume 4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:22:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a83f8f-9b1a-4cca-b672-3ade2efc049d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:27 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:27 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:28 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:28 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 1G
Sep 25 17:22:28 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:28 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 1G" returned: 0 in 0.506s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:28 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:28 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:28 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:28 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 is being set with open permissions: ugo+rw
Sep 25 17:22:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:28 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:28 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:29 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.264s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:29 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info
Sep 25 17:22:29 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:29 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:29 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info is being set with open permissions: ugo+rw
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:29 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info
Sep 25 17:22:29 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:29 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.info" returned: 0 in 0.254s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d2f8f6a9-646a-452c-8b95-5a5208235fb4 tempest-VolumeDependencyTests-1988963940 None] Create snapshot completed successfully
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Flow 'volume_create_manager' (2075e777-c86f-40ab-87bf-4aa764f3d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3607d258-60be-411f-b3e5-075f6183539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3607d258-60be-411f-b3e5-075f6183539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1473352242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94702613-af7a-467e-bc4e-f0d62ed46014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc9fd93294342feacfaf6b4ce666a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bc4d6f0-264c-4e92-9493-02fdc3e05e08,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:31Z,use_quota=True,user_id='d652967e88334351b3ed77f2965a8bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66b247-cb1b-4b31-b8c6-e4a43c346178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae66b247-cb1b-4b31-b8c6-e4a43c346178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69407c2-86c0-42c4-88d6-51542300a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69407c2-86c0-42c4-88d6-51542300a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94702613-af7a-467e-bc4e-f0d62ed46014', 'volume_name': 'volume-94702613-af7a-467e-bc4e-f0d62ed46014', 'volume_size': 1, 'snapshot_id': '2bc4d6f0-264c-4e92-9493-02fdc3e05e08'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86ed104-a02f-4e6a-9c6e-3eebf8f95ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86ed104-a02f-4e6a-9c6e-3eebf8f95ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466b4704-48e8-465d-bbbd-991af7adf101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Volume 94702613-af7a-467e-bc4e-f0d62ed46014: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94702613-af7a-467e-bc4e-f0d62ed46014', 'volume_size': 1, 'snapshot_id': '2bc4d6f0-264c-4e92-9493-02fdc3e05e08'}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-94702613-af7a-467e-bc4e-f0d62ed46014" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-94702613-af7a-467e-bc4e-f0d62ed46014" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Creating volume 94702613-af7a-467e-bc4e-f0d62ed46014 from snapshot 2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] snapshot: 2bc4d6f0-264c-4e92-9493-02fdc3e05e08, volume: 94702613-af7a-467e-bc4e-f0d62ed46014,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b3dee-4fc1-4219-8c13-79eef40d6297]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:31 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:31 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:31 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.446s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e897a82-61fb-4559-884c-ab9d6f9e2182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6ca068-4392-4c11-a87c-0643a4f2b154]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Flow 'volume_create_manager' (eee98409-3b62-4d9d-91c1-0ef28171ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabe5a7c-28af-4106-a449-fed5e8ba9b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabe5a7c-28af-4106-a449-fed5e8ba9b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb75f4ef-87b4-4c77-acf1-cd2eb200388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd110779052499cae49bbc3d9ce32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:32Z,use_quota=True,user_id='746deb71e94e41afb79da48cb365e3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050998a0-b2fe-4570-aa6d-cf9a42b60d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050998a0-b2fe-4570-aa6d-cf9a42b60d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5c454d-83eb-4f01-a64b-45cf84660d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 17:22:32 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:32 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5c454d-83eb-4f01-a64b-45cf84660d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb75f4ef-87b4-4c77-acf1-cd2eb200388f', 'volume_name': 'volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f', 'volume_size': 1, 'image_id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '226adfc8231aa568c12ffc307cd67448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbd110779052499cae49bbc3d9ce32c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22615e73d1b232784e7455d49dc568c70e24dcbfce2ad54b8cf99431a5aace38c357c902b15f5c2e87cd275240038a5328711149cc3c98f4ffb7a3bdee329612', 'id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48083b0e0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a689b8-8b09-43e4-af95-bdebec33559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a689b8-8b09-43e4-af95-bdebec33559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1896da5e-9d3f-4b56-9561-7d1628e1d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f', 'volume_size': 1, 'image_id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '226adfc8231aa568c12ffc307cd67448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbd110779052499cae49bbc3d9ce32c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22615e73d1b232784e7455d49dc568c70e24dcbfce2ad54b8cf99431a5aace38c357c902b15f5c2e87cd275240038a5328711149cc3c98f4ffb7a3bdee329612', 'id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48083b0e0>}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Trying to clone cb75f4ef-87b4-4c77-acf1-cd2eb200388f from image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 17:22:32 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:32 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014
Sep 25 17:22:32 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 17:22:32 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f95ae9-9365-429e-aa97-3299be48bd1c]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:32 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:32 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:32 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:33 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:33 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:33 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 1 in 0.618s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:33 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Temporary image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 is fetched for user 746deb71e94e41afb79da48cb365e3fc. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 17:22:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc763bd-2250-4270-afa2-7226333743d2]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:33 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:34 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:34 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:34 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:34 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 1 in 0.536s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:39 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014" returned: 0 in 7.044s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:22:39 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Converted 1024.00 MB image at 145.35 MB/s
Sep 25 17:22:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 is being set with open permissions: ugo+rw
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:39 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014
Sep 25 17:22:39 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:39 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014" returned: 0 in 0.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" released by "_copy_volume_from_snapshot" :: held 8.301s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-94702613-af7a-467e-bc4e-f0d62ed46014" released by "_create_volume_from_snapshot" :: held 8.373s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.388s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.908s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb75f4ef-87b4-4c77-acf1-cd2eb200388f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd110779052499cae49bbc3d9ce32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:32Z,use_quota=True,user_id='746deb71e94e41afb79da48cb365e3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Creating volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:39 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1073741824
Sep 25 17:22:39 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466b4704-48e8-465d-bbbd-991af7adf101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94702613-af7a-467e-bc4e-f0d62ed46014', 'volume_size': 1, 'snapshot_id': '2bc4d6f0-264c-4e92-9493-02fdc3e05e08'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010589fa-92c1-436e-9917-e317847a2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Volume volume-94702613-af7a-467e-bc4e-f0d62ed46014 (94702613-af7a-467e-bc4e-f0d62ed46014): created successfully
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010589fa-92c1-436e-9917-e317847a2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Flow 'volume_create_manager' (2075e777-c86f-40ab-87bf-4aa764f3d35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4081c7bd-6978-4019-a649-524c545e871b tempest-VolumeDependencyTests-1988963940 None] Created volume successfully.
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Deleting offline snapshot 2bc4d6f0-264c-4e92-9493-02fdc3e05e08 of volume 4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] snapshot_file for this snap is: volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0261a47-1bab-4df6-a645-448d9865eefa]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:40 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1073741824" returned: 0 in 0.528s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:40 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:40 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:40 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f
Sep 25 17:22:40 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:40 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.371s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e897a82-61fb-4559-884c-ab9d6f9e2182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:22:40 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e13aa7-013f-4ae0-8058-6eda8f676ff4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Attempting download of 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}])) to volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee4ee70-f24e-4f2b-aab5-08112ab71bb2]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:40 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:40 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:40 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv
Sep 25 17:22:40 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:41 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:41 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv
Sep 25 17:22:41 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:41 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.580s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:41 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:41 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:41 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv" returned: 1 in 0.363s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_6lub0vhv' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b888a6-0117-43d0-b8d7-97ec8c9b4f56]: (4, 'raw') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:41 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:41 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:41 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.352s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:41 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08
Sep 25 17:22:41 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:41 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:41 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182.2bc4d6f0-264c-4e92-9493-02fdc3e05e08" returned: 0 in 0.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-2bc4d6f0-264c-4e92-9493-02fdc3e05e08" released by "_delete_snapshot" :: held 1.769s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:42 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD
Sep 25 17:22:42 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" released by "delete_snapshot" :: held 1.796s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Created reservations ['b63223b3-9de1-48ef-a758-a48867cac5c1', '22077c23-62ab-4680-9336-643248088227', '6cf859b4-3212-454a-a96e-3aa3a994ece4', '5e9b72f1-599c-4e7d-a36e-ebfa0150e311'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Delete snapshot completed successfully.
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3793b3ba-928f-4159-b404-4c4aadc90344 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-2bc4d6f0-264c-4e92-9493-02fdc3e05e08-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:42 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 was raw, converting to qcow2 {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:42 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f
Sep 25 17:22:42 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-4e897a82-61fb-4559-884c-ab9d6f9e2182-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-4e897a82-61fb-4559-884c-ab9d6f9e2182-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc85811-06b2-4a18-8506-687b3645cd27]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:42 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:42 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:42 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" returned: 0 in 0.476s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1_luw8ablodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:22:42 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:42 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1G
Sep 25 17:22:42 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:42 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.401s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:42 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182
Sep 25 17:22:42 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:43 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f 1G" returned: 0 in 0.313s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Downloaded image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}])) to volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Temporary image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 for user 746deb71e94e41afb79da48cb365e3fc is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Marking volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Copying metadata from image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 to cb75f4ef-87b4-4c77-acf1-cd2eb200388f. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Creating volume glance metadata for volume cb75f4ef-87b4-4c77-acf1-cd2eb200388f backed by image 1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1 with: {'image_id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '226adfc8231aa568c12ffc307cd67448', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 17:22:43 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1896da5e-9d3f-4b56-9561-7d1628e1d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f', 'volume_size': 1, 'image_id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '226adfc8231aa568c12ffc307cd67448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbd110779052499cae49bbc3d9ce32c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22615e73d1b232784e7455d49dc568c70e24dcbfce2ad54b8cf99431a5aace38c357c902b15f5c2e87cd275240038a5328711149cc3c98f4ffb7a3bdee329612', 'id': '1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 22, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 22, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a9c2fbd-ab0c-41f4-b2b0-f24e3ea496e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x79a48083b0e0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13b68b7-68f2-45eb-bae6-12be334b2293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4e897a82-61fb-4559-884c-ab9d6f9e2182" returned: 0 in 0.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-4e897a82-61fb-4559-884c-ab9d6f9e2182" released by "delete_volume" :: held 0.737s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Volume volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f (cb75f4ef-87b4-4c77-acf1-cd2eb200388f): created successfully
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13b68b7-68f2-45eb-bae6-12be334b2293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Flow 'volume_create_manager' (eee98409-3b62-4d9d-91c1-0ef28171ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ddcbd636-44de-48b6-a833-d0ac37c9afd1 tempest-VolumeImageDependencyTests-1768107227 None] Created volume successfully.
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Created reservations ['87c2a095-774d-4b90-b545-a90a467fe547', '3a4e8366-3add-4057-909b-8247d479d47e', '7efcbd64-c562-4256-9277-cad147fb3575', 'edbd0631-ed56-4d9c-9987-8f6f8fe293a6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:43 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:43 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:43 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-94702613-af7a-467e-bc4e-f0d62ed46014-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Deleted volume successfully.
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-94702613-af7a-467e-bc4e-f0d62ed46014-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-004446a6-8ac0-408b-9725-66351fa5865b tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-4e897a82-61fb-4559-884c-ab9d6f9e2182-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d72f6-b6ed-4b79-90f7-737b60d05d25]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:43 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014
Sep 25 17:22:43 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:44 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014" returned: 0 in 0.410s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Acquiring lock "cinder-cb75f4ef-87b4-4c77-acf1-cd2eb200388f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:44 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "cinder-cb75f4ef-87b4-4c77-acf1-cd2eb200388f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:44 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=188,cinder:UPDATE=256,cinder:INSERT=76,cinder:DELETE=21 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Acquiring lock "cinder-quobyte-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "cinder-quobyte-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd55b70-199d-420d-8075-6765034ec230]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:44 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f
Sep 25 17:22:44 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:44 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-94702613-af7a-467e-bc4e-f0d62ed46014" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-quobyte-94702613-af7a-467e-bc4e-f0d62ed46014" released by "delete_volume" :: held 0.768s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=200,cinder:UPDATE=269,cinder:DELETE=26,cinder:INSERT=65 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Created reservations ['d3b29e71-37b1-4f77-aee1-ad3b33c78a9b', 'deb4a833-cde4-4dc6-af8b-de4c51fac987', 'c74b5581-5781-4ced-9351-7ea312cb93fc', '37ac546d-0af1-4036-95b9-70df793d546a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:44 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:44 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:44 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" returned: 0 in 0.474s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:44 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f
Sep 25 17:22:44 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:44 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.373s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Deleted volume successfully.
Sep 25 17:22:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7761dc55-90e3-4eca-ae20-6dfad7675d50 tempest-VolumeDependencyTests-1988963940 None] Lock "cinder-94702613-af7a-467e-bc4e-f0d62ed46014-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:45 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" returned: 0 in 0.380s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "cinder-quobyte-cb75f4ef-87b4-4c77-acf1-cd2eb200388f" released by "delete_volume" :: held 0.919s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Created reservations ['d42093e7-423f-4850-8c8f-a0417eef0870', '1395af60-2af6-45b5-87a5-398cefeede03', '72d1da92-50bd-4185-a08b-beb85ab60b9b', 'f1ee13b0-1aaa-4898-aee7-3ac98b48d502'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:45 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:45 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:45 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.349s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Deleted volume successfully.
Sep 25 17:22:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e19ed4b8-f6f2-490e-8149-3844fff1baba tempest-VolumeImageDependencyTests-1768107227 None] Lock "cinder-cb75f4ef-87b4-4c77-acf1-cd2eb200388f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c5feddef-d078-431f-a254-89f8aceac1ca tempest-ProjectAdminTests-1489302395 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (28c513b8-a16b-46cc-935c-19e63eb22131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8be6e4-3bdb-4f88-a50a-9d486300f30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8be6e4-3bdb-4f88-a50a-9d486300f30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210920501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0117b37b-7f94-4cca-b523-2f46d1827f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:50Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb45cc-b8e5-4841-b9cd-a99fca01ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb45cc-b8e5-4841-b9cd-a99fca01ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999a44b2-a73e-475a-b4c9-04d26d5723bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999a44b2-a73e-475a-b4c9-04d26d5723bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0117b37b-7f94-4cca-b523-2f46d1827f82', 'volume_name': 'volume-0117b37b-7f94-4cca-b523-2f46d1827f82', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a621e2-68f0-416d-9600-e83b1650f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a621e2-68f0-416d-9600-e83b1650f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1fa740-333f-4177-b3eb-b61005a2cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Volume 0117b37b-7f94-4cca-b523-2f46d1827f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0117b37b-7f94-4cca-b523-2f46d1827f82', 'volume_size': 1}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210920501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0117b37b-7f94-4cca-b523-2f46d1827f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:50Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Creating volume 0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:50 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 1073741824
Sep 25 17:22:50 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:50 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 1073741824" returned: 0 in 0.523s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:50 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82
Sep 25 17:22:50 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:51 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1fa740-333f-4177-b3eb-b61005a2cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0117b37b-7f94-4cca-b523-2f46d1827f82', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670860ce-0a51-4676-a95f-8c7a5dfc6110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Volume volume-0117b37b-7f94-4cca-b523-2f46d1827f82 (0117b37b-7f94-4cca-b523-2f46d1827f82): created successfully
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670860ce-0a51-4676-a95f-8c7a5dfc6110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (28c513b8-a16b-46cc-935c-19e63eb22131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3b105f3e-cf73-4497-9917-db6789f121ab tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:22:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 8172c16e-9a43-4637-8d4d-1d72090a797f of volume 0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:22:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03766da-fdad-4f19-a75a-c9523c5ef2bb]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:53 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82
Sep 25 17:22:53 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:53 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82" returned: 0 in 0.409s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:53 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f 1G
Sep 25 17:22:53 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:53 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f 1G" returned: 0 in 0.467s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0117b37b-7f94-4cca-b523-2f46d1827f82 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:53 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0117b37b-7f94-4cca-b523-2f46d1827f82 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f
Sep 25 17:22:53 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:54 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0117b37b-7f94-4cca-b523-2f46d1827f82 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f" returned: 0 in 0.329s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f is being set with open permissions: ugo+rw
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:54 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f
Sep 25 17:22:54 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:54 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:54 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info
Sep 25 17:22:54 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:54 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info is being set with open permissions: ugo+rw
Sep 25 17:22:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:54 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info
Sep 25 17:22:54 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:55 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.info" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-999d3257-f19e-4504-b1f6-9e2758587c9a tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-8172c16e-9a43-4637-8d4d-1d72090a797f-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-8172c16e-9a43-4637-8d4d-1d72090a797f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-8172c16e-9a43-4637-8d4d-1d72090a797f" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-8172c16e-9a43-4637-8d4d-1d72090a797f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 8172c16e-9a43-4637-8d4d-1d72090a797f of volume 0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb3d04-61f6-45f8-bdda-777981d0f081]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:56 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f
Sep 25 17:22:56 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:56 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f" returned: 0 in 0.422s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0117b37b-7f94-4cca-b523-2f46d1827f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f99db-5bce-4027-afc7-e720965fab15]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:56 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82
Sep 25 17:22:56 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:57 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82" returned: 0 in 0.448s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:57 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f
Sep 25 17:22:57 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:57 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f" returned: 0 in 0.373s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:57 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f
Sep 25 17:22:57 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:57 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82.8172c16e-9a43-4637-8d4d-1d72090a797f" returned: 0 in 0.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-8172c16e-9a43-4637-8d4d-1d72090a797f" released by "_delete_snapshot" :: held 1.708s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" released by "delete_snapshot" :: held 1.738s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Created reservations ['7436ab06-6566-4da7-b34a-bcf886d9cdad', '44173fa9-4deb-4ba3-8483-ca3808940a76', '0c620148-9e3a-48ba-9364-5be8076dc536', '39fd9ed8-7085-476f-8522-fee67d341067'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab92da9-b394-472c-8303-cdd7597cac13 tempest-ProjectMemberTests-770038459 None] Lock "cinder-8172c16e-9a43-4637-8d4d-1d72090a797f-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-0117b37b-7f94-4cca-b523-2f46d1827f82-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "cinder-0117b37b-7f94-4cca-b523-2f46d1827f82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef63b2-e9af-4b79-9709-550708664c44]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Flow 'volume_create_manager' (8dff51bc-dff2-4227-b083-1d3450b61cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ccdf86-9d2c-42f5-94e7-38e52d0c92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ccdf86-9d2c-42f5-94e7-38e52d0c92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119369677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fafc4-eb37-47ed-b14b-a633c71c58c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ddf7c86d194ea3be03c3710f1fe877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:58Z,use_quota=True,user_id='51636faff5a34eae99ee3785172d6384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad57fc25-4419-4cab-af7a-6707abc5ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad57fc25-4419-4cab-af7a-6707abc5ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ab3da7-82c9-4d67-b3ef-6472b6b396a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ab3da7-82c9-4d67-b3ef-6472b6b396a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97fafc4-eb37-47ed-b14b-a633c71c58c9', 'volume_name': 'volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4510c29-c7f0-4a90-8018-b4f701ffa321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4510c29-c7f0-4a90-8018-b4f701ffa321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2a8fe2-e450-4f88-b122-282179431674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Volume c97fafc4-eb37-47ed-b14b-a633c71c58c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9', 'volume_size': 1}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119369677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fafc4-eb37-47ed-b14b-a633c71c58c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ddf7c86d194ea3be03c3710f1fe877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:58Z,use_quota=True,user_id='51636faff5a34eae99ee3785172d6384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Creating volume c97fafc4-eb37-47ed-b14b-a633c71c58c9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:58 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82
Sep 25 17:22:58 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:58 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 1073741824
Sep 25 17:22:58 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:58 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82" returned: 0 in 0.408s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:58 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82
Sep 25 17:22:58 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:59 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 1073741824" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:59 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9
Sep 25 17:22:59 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:59 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-0117b37b-7f94-4cca-b523-2f46d1827f82" returned: 0 in 0.296s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-0117b37b-7f94-4cca-b523-2f46d1827f82" released by "delete_volume" :: held 0.790s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Created reservations ['2ee76437-d633-4555-ae93-57444ef4a29e', '5e5a0b3f-48e2-4f4d-be4a-d04a733518b1', '5444f079-3d83-40f2-8ef6-ea93ff7304f5', 'a85f6a3e-163a-43a8-81da-fee6a1f54d81'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:59 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:22:59 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:22:59 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2a8fe2-e450-4f88-b122-282179431674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293befc1-ed31-40d3-8dda-8c096e0765ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Volume volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 (c97fafc4-eb37-47ed-b14b-a633c71c58c9): created successfully
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293befc1-ed31-40d3-8dda-8c096e0765ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Flow 'volume_create_manager' (8dff51bc-dff2-4227-b083-1d3450b61cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-76bb03af-96a6-4be7-8a67-3c0abb95ffe9 tempest-ProjectReaderTests-1783811243 None] Created volume successfully.
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (a34fa12a-a90c-497c-bf43-124540bdf00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd075ff0-7ff3-4fee-9323-fe2a7e767aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.291s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:22:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd075ff0-7ff3-4fee-9323-fe2a7e767aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4579241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87b655-7c0b-4d96-8815-12c32bfe6491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:00Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e51a39b-d606-46b8-ad25-0277be788c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e51a39b-d606-46b8-ad25-0277be788c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c16d780-2292-4716-a2c7-a6e5b2702e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c16d780-2292-4716-a2c7-a6e5b2702e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc87b655-7c0b-4d96-8815-12c32bfe6491', 'volume_name': 'volume-dc87b655-7c0b-4d96-8815-12c32bfe6491', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f8a10a-456c-4c18-aae0-88fc1dc30853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f8a10a-456c-4c18-aae0-88fc1dc30853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e87ede2-2d43-4b29-ad42-3e3ef7b49bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:22:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Volume dc87b655-7c0b-4d96-8815-12c32bfe6491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc87b655-7c0b-4d96-8815-12c32bfe6491', 'volume_size': 1}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4579241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87b655-7c0b-4d96-8815-12c32bfe6491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:00Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Creating volume dc87b655-7c0b-4d96-8815-12c32bfe6491 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:22:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:22:59 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 1073741824
Sep 25 17:22:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de87131a-8e66-4855-b128-170f2189876a tempest-ProjectMemberTests-770038459 None] Lock "cinder-0117b37b-7f94-4cca-b523-2f46d1827f82-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:22:59 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (1b93739b-a1b6-47e2-ba30-b74cab9adc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718892ee-d288-4e7a-b593-4d2eb7f9ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718892ee-d288-4e7a-b593-4d2eb7f9ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812429879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4845732c-7f22-4bb0-81f0-d20bc35e3648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:00Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b34aa9b-8b1c-46f8-8b9d-6b6d98669632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b34aa9b-8b1c-46f8-8b9d-6b6d98669632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23899a9d-2a55-492e-ae2b-1a0f4fac34c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23899a9d-2a55-492e-ae2b-1a0f4fac34c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4845732c-7f22-4bb0-81f0-d20bc35e3648', 'volume_name': 'volume-4845732c-7f22-4bb0-81f0-d20bc35e3648', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657d039f-3c54-403e-a212-b30ee7b2da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657d039f-3c54-403e-a212-b30ee7b2da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bfc974-44b1-44d2-9a4b-be5ee4b5237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Volume 4845732c-7f22-4bb0-81f0-d20bc35e3648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4845732c-7f22-4bb0-81f0-d20bc35e3648', 'volume_size': 1}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:00 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 1073741824" returned: 0 in 0.445s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:00 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491
Sep 25 17:23:00 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:00 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812429879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4845732c-7f22-4bb0-81f0-d20bc35e3648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:00Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Creating volume 4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e87ede2-2d43-4b29-ad42-3e3ef7b49bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc87b655-7c0b-4d96-8815-12c32bfe6491', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 1073741824
Sep 25 17:23:00 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca2dc02-6471-4ee4-9734-8d63c18789e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Volume volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 (dc87b655-7c0b-4d96-8815-12c32bfe6491): created successfully
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca2dc02-6471-4ee4-9734-8d63c18789e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (a34fa12a-a90c-497c-bf43-124540bdf00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3b0420df-5234-4677-b729-c8735e0b0e7c tempest-ProjectReaderTests-228671652 None] Created volume successfully.
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "cinder-c97fafc4-eb37-47ed-b14b-a633c71c58c9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-c97fafc4-eb37-47ed-b14b-a633c71c58c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "cinder-quobyte-c97fafc4-eb37-47ed-b14b-a633c71c58c9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-quobyte-c97fafc4-eb37-47ed-b14b-a633c71c58c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35c56b-4c41-4c5c-b80d-7bd399df4069]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:00 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9
Sep 25 17:23:00 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:01 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 1073741824" returned: 0 in 0.495s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:01 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648
Sep 25 17:23:01 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:01 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9" returned: 0 in 0.391s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:01 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9
Sep 25 17:23:01 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:01 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bfc974-44b1-44d2-9a4b-be5ee4b5237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4845732c-7f22-4bb0-81f0-d20bc35e3648', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4038cc5c-e4f8-4d75-9d20-4dd2b43fce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Volume volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 (4845732c-7f22-4bb0-81f0-d20bc35e3648): created successfully
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4038cc5c-e4f8-4d75-9d20-4dd2b43fce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (1b93739b-a1b6-47e2-ba30-b74cab9adc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fc5ff088-16d0-4a84-ac88-6bd90240fab5 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:01 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-c97fafc4-eb37-47ed-b14b-a633c71c58c9" returned: 0 in 0.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-quobyte-c97fafc4-eb37-47ed-b14b-a633c71c58c9" released by "delete_volume" :: held 0.705s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Created reservations ['cbadf97a-9e1d-4dbc-8321-851d318a1b8e', 'e14a777e-17a4-4af5-8938-a62cbc122162', '3894ec88-d3bc-435c-aa94-4afc55ed1f20', 'f002a2fd-e3e5-4873-8fea-b22ee343c428'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:01 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:01 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-dc87b655-7c0b-4d96-8815-12c32bfe6491-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:01 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.324s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Deleted volume successfully.
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "cinder-dc87b655-7c0b-4d96-8815-12c32bfe6491-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8032fe8e-16f9-4715-b622-82822e6e7b55 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-c97fafc4-eb37-47ed-b14b-a633c71c58c9-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-quobyte-dc87b655-7c0b-4d96-8815-12c32bfe6491" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-dc87b655-7c0b-4d96-8815-12c32bfe6491" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f965a92-5e51-43c9-89d8-e208502e1cfe]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:02 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491
Sep 25 17:23:02 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 59869063-d8ab-4b5d-ab36-f840b898a3e0 of volume 4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129fb54-d338-4970-93ec-82e5489388cd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:02 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491" returned: 0 in 0.473s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:02 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648
Sep 25 17:23:02 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:02 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491
Sep 25 17:23:02 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Flow 'volume_create_manager' (ba672438-5f1b-45bc-9dc0-480df005481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f817dc65-a0e7-4a9f-8763-d54d30839b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f817dc65-a0e7-4a9f-8763-d54d30839b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611317390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f9b271-fe00-4e85-b397-ca8c9b38863e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ddf7c86d194ea3be03c3710f1fe877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:03Z,use_quota=True,user_id='51636faff5a34eae99ee3785172d6384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051d5ea4-34b1-49a7-97b9-400ae9914347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051d5ea4-34b1-49a7-97b9-400ae9914347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7227a-3836-4d10-9159-7166db5e09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7227a-3836-4d10-9159-7166db5e09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f9b271-fe00-4e85-b397-ca8c9b38863e', 'volume_name': 'volume-26f9b271-fe00-4e85-b397-ca8c9b38863e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8578f169-c3fe-4083-aefd-642c5cc15e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8578f169-c3fe-4083-aefd-642c5cc15e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee0ac9-6434-4c26-8ecc-3b2700bae095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Volume 26f9b271-fe00-4e85-b397-ca8c9b38863e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f9b271-fe00-4e85-b397-ca8c9b38863e', 'volume_size': 1}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:02 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-dc87b655-7c0b-4d96-8815-12c32bfe6491" returned: 0 in 0.261s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-dc87b655-7c0b-4d96-8815-12c32bfe6491" released by "delete_volume" :: held 0.795s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Created reservations ['bb6c6b91-d560-4522-8af1-ccfae0ab3eed', '499e6e98-f834-45c8-a553-592ee5a5fe60', '03d3fc38-0cef-4ef2-9a47-bab3ddd49a20', '959f2a66-6b3c-4886-89eb-1aced748b5cc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:02 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648" returned: 0 in 0.444s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:02 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 1G
Sep 25 17:23:02 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:03 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:03 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:03 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.321s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Deleted volume successfully.
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda5941b-01a7-45b9-a050-6047600c7de3 tempest-ProjectReaderTests-228671652 None] Lock "cinder-dc87b655-7c0b-4d96-8815-12c32bfe6491-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:03 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 1G" returned: 0 in 0.512s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:03 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0
Sep 25 17:23:03 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:03 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:03 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (318a1151-908f-4efa-b48d-2a052b3b4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e042ea-c0d4-41dd-b9f1-ebbbd3c36da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e042ea-c0d4-41dd-b9f1-ebbbd3c36da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236706312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b474b5d6-1963-452a-9a74-b71365fbb91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:04Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb15f07-8aaf-441b-8450-e745c755ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb15f07-8aaf-441b-8450-e745c755ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38885ac6-c7dc-46c9-b29d-3e7d2c3f4b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38885ac6-c7dc-46c9-b29d-3e7d2c3f4b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b474b5d6-1963-452a-9a74-b71365fbb91f', 'volume_name': 'volume-b474b5d6-1963-452a-9a74-b71365fbb91f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97533879-ba17-489a-81ef-461fa87a85ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97533879-ba17-489a-81ef-461fa87a85ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18655fc3-46ff-47ea-81d3-59afcd75dab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Volume b474b5d6-1963-452a-9a74-b71365fbb91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b474b5d6-1963-452a-9a74-b71365fbb91f', 'volume_size': 1}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:03 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 is being set with open permissions: ugo+rw
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:03 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0
Sep 25 17:23:03 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:03 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:23:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:23:04 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0" returned: 0 in 0.239s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:04 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info
Sep 25 17:23:04 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:04 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info" returned: 0 in 0.244s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info is being set with open permissions: ugo+rw
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:04 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info
Sep 25 17:23:04 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:04 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.info" returned: 0 in 0.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611317390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f9b271-fe00-4e85-b397-ca8c9b38863e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ddf7c86d194ea3be03c3710f1fe877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:03Z,use_quota=True,user_id='51636faff5a34eae99ee3785172d6384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Creating volume 26f9b271-fe00-4e85-b397-ca8c9b38863e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:04 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:04 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e 1073741824
Sep 25 17:23:04 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1a6ea762-4870-43ab-ad24-40867c4784ee tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:04 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e 1073741824" returned: 0 in 0.408s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:05 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e
Sep 25 17:23:05 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:05 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236706312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b474b5d6-1963-452a-9a74-b71365fbb91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:04Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Creating volume b474b5d6-1963-452a-9a74-b71365fbb91f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee0ac9-6434-4c26-8ecc-3b2700bae095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f9b271-fe00-4e85-b397-ca8c9b38863e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:05 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f 1073741824
Sep 25 17:23:05 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0937c45e-3ae7-4eae-8815-2b3439de7f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Volume volume-26f9b271-fe00-4e85-b397-ca8c9b38863e (26f9b271-fe00-4e85-b397-ca8c9b38863e): created successfully
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0937c45e-3ae7-4eae-8815-2b3439de7f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Flow 'volume_create_manager' (ba672438-5f1b-45bc-9dc0-480df005481f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-329de696-322c-4132-a5c5-d16c0f0f10c9 tempest-ProjectReaderTests-1783811243 None] Created volume successfully.
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-59869063-d8ab-4b5d-ab36-f840b898a3e0-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-59869063-d8ab-4b5d-ab36-f840b898a3e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-59869063-d8ab-4b5d-ab36-f840b898a3e0" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-59869063-d8ab-4b5d-ab36-f840b898a3e0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 59869063-d8ab-4b5d-ab36-f840b898a3e0 of volume 4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee4f5b-4246-491f-bec1-315115d0eb79]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "cinder-26f9b271-fe00-4e85-b397-ca8c9b38863e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-26f9b271-fe00-4e85-b397-ca8c9b38863e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:05 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0
Sep 25 17:23:05 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "cinder-quobyte-26f9b271-fe00-4e85-b397-ca8c9b38863e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-quobyte-26f9b271-fe00-4e85-b397-ca8c9b38863e" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:05 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f 1073741824" returned: 0 in 0.543s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c277f-3305-40db-8511-aaeac25405e7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:05 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f
Sep 25 17:23:05 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:05 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e
Sep 25 17:23:05 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0" returned: 0 in 0.463s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4845732c-7f22-4bb0-81f0-d20bc35e3648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b649186f-e3eb-4fec-9b72-945013ad897b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:06 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f" returned: 0 in 0.282s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18655fc3-46ff-47ea-81d3-59afcd75dab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b474b5d6-1963-452a-9a74-b71365fbb91f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33093fa2-d200-431e-a9a6-a4736cd3aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Volume volume-b474b5d6-1963-452a-9a74-b71365fbb91f (b474b5d6-1963-452a-9a74-b71365fbb91f): created successfully
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33093fa2-d200-431e-a9a6-a4736cd3aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (318a1151-908f-4efa-b48d-2a052b3b4853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:06 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648
Sep 25 17:23:06 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e1c31f08-687c-4077-ac0f-7ba1437f7105 tempest-ProjectReaderTests-228671652 None] Created volume successfully.
Sep 25 17:23:06 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e" returned: 0 in 0.416s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:06 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e
Sep 25 17:23:06 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:06 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0
Sep 25 17:23:06 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-26f9b271-fe00-4e85-b397-ca8c9b38863e" returned: 0 in 0.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-quobyte-26f9b271-fe00-4e85-b397-ca8c9b38863e" released by "delete_volume" :: held 0.741s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Created reservations ['feecb1e6-ead4-4829-bf3d-e1738083b8c6', 'c84007af-934d-4a9d-9970-bb24b9c044d1', '24a7c130-f5fc-486a-bf88-3721bb5e198b', '834d1fa5-5f3a-4423-b34e-a62facd40a56'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:06 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:06 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0" returned: 0 in 0.463s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:06 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0
Sep 25 17:23:06 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:06 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:06 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Deleted volume successfully.
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f1e82168-e13c-4484-8cf9-9e2f28a69427 tempest-ProjectReaderTests-1783811243 None] Lock "cinder-26f9b271-fe00-4e85-b397-ca8c9b38863e-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-b474b5d6-1963-452a-9a74-b71365fbb91f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "cinder-b474b5d6-1963-452a-9a74-b71365fbb91f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-quobyte-b474b5d6-1963-452a-9a74-b71365fbb91f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-b474b5d6-1963-452a-9a74-b71365fbb91f" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:07 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648.59869063-d8ab-4b5d-ab36-f840b898a3e0" returned: 0 in 0.322s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e78563-59ad-4166-9d86-5f6dbbe8562f]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-59869063-d8ab-4b5d-ab36-f840b898a3e0" released by "_delete_snapshot" :: held 1.788s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" released by "delete_snapshot" :: held 1.816s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:07 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f
Sep 25 17:23:07 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Created reservations ['ae771d6e-bba9-43a7-82fd-df3784712fd8', '382712f3-bcc2-4353-b093-4d5c6d8f9364', 'd9ada41c-b564-4e30-aec6-1d6949c44c12', '4f6f348d-6148-44ae-924f-bba2f574db82'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8c44d385-5b37-44f9-b878-8932f9d9a8a4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-59869063-d8ab-4b5d-ab36-f840b898a3e0-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:07 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:07 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f
Sep 25 17:23:07 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-4845732c-7f22-4bb0-81f0-d20bc35e3648-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "cinder-4845732c-7f22-4bb0-81f0-d20bc35e3648-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba3e96-360c-486f-b40a-b0d63a7a2bcd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:07 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:07 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648
Sep 25 17:23:08 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-b474b5d6-1963-452a-9a74-b71365fbb91f" returned: 0 in 0.336s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-b474b5d6-1963-452a-9a74-b71365fbb91f" released by "delete_volume" :: held 0.793s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Created reservations ['89e8eb1b-b447-44a2-a5ff-7997b53cd949', 'f02c82ae-a178-4297-b301-234faeefa828', '94addc5e-7f1f-4802-a992-a271c1730fc0', '9e42a060-6c6a-4193-8340-48e21b8060f1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:08 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:08 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:08 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648" returned: 0 in 0.458s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:08 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648
Sep 25 17:23:08 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:08 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Deleted volume successfully.
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f90d2334-988c-4eab-84d8-79f516befd91 tempest-ProjectReaderTests-228671652 None] Lock "cinder-b474b5d6-1963-452a-9a74-b71365fbb91f-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:08 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-4845732c-7f22-4bb0-81f0-d20bc35e3648" returned: 0 in 0.315s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-4845732c-7f22-4bb0-81f0-d20bc35e3648" released by "delete_volume" :: held 0.855s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Created reservations ['328f6299-a67c-4aa2-ab8f-6d171a40c252', '7e24415f-c576-4172-ae7a-94dc5d76928b', '207a0b2c-0df8-4768-9072-8efa679cb981', 'd5a09546-9c74-4d16-a798-734da84141c6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:08 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:08 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (f71e4a10-7d49-4fdb-8f68-39abefe165f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b60af6-5a53-4fcc-972a-76a71ec18955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b60af6-5a53-4fcc-972a-76a71ec18955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115413126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c93b255-d529-4c0f-9816-aba8d8b26593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:09Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8fb7f2-a7fc-4d80-9af9-6797665c35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8fb7f2-a7fc-4d80-9af9-6797665c35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2104723-c5b5-4672-9b69-69ec20c37c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2104723-c5b5-4672-9b69-69ec20c37c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c93b255-d529-4c0f-9816-aba8d8b26593', 'volume_name': 'volume-5c93b255-d529-4c0f-9816-aba8d8b26593', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55371d6-22e3-4610-a320-e86785a5e9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55371d6-22e3-4610-a320-e86785a5e9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b512fc-a0bc-4232-bbb8-c4bc07a2b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Volume 5c93b255-d529-4c0f-9816-aba8d8b26593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c93b255-d529-4c0f-9816-aba8d8b26593', 'volume_size': 1}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115413126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c93b255-d529-4c0f-9816-aba8d8b26593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:09Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Creating volume 5c93b255-d529-4c0f-9816-aba8d8b26593 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:09 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 1073741824
Sep 25 17:23:09 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:09 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.337s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc0ba901-46d4-4d9c-a32c-f93c51f81afb tempest-ProjectMemberTests-770038459 None] Lock "cinder-4845732c-7f22-4bb0-81f0-d20bc35e3648-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (bf28d39a-8cbc-498c-9ed2-b02cb6553f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76353c3b-3991-4f06-a65f-6ebcad4c7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76353c3b-3991-4f06-a65f-6ebcad4c7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360001494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac7080f-8948-490a-8c78-b6064a8e28c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:09Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115748d-558f-4c98-914c-716062f28ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115748d-558f-4c98-914c-716062f28ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bc560-0aad-40a6-a12a-1d167197b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bc560-0aad-40a6-a12a-1d167197b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac7080f-8948-490a-8c78-b6064a8e28c1', 'volume_name': 'volume-5ac7080f-8948-490a-8c78-b6064a8e28c1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c6e1fa-b8b6-43d3-b064-c1f3ed414dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c6e1fa-b8b6-43d3-b064-c1f3ed414dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc3a037-d118-44b5-b2db-a84b578edb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Volume 5ac7080f-8948-490a-8c78-b6064a8e28c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac7080f-8948-490a-8c78-b6064a8e28c1', 'volume_size': 1}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:09 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 1073741824" returned: 0 in 0.469s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:09 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593
Sep 25 17:23:09 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:09 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593" returned: 0 in 0.234s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360001494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac7080f-8948-490a-8c78-b6064a8e28c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:09Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Creating volume 5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b512fc-a0bc-4232-bbb8-c4bc07a2b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c93b255-d529-4c0f-9816-aba8d8b26593', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 1073741824
Sep 25 17:23:09 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1155edc3-9843-4d0b-bdfd-4281065e71f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Volume volume-5c93b255-d529-4c0f-9816-aba8d8b26593 (5c93b255-d529-4c0f-9816-aba8d8b26593): created successfully
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1155edc3-9843-4d0b-bdfd-4281065e71f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (f71e4a10-7d49-4fdb-8f68-39abefe165f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ad2bcf2c-0c48-4419-9159-e98eb89b9284 tempest-ProjectReaderTests-228671652 None] Created volume successfully.
Sep 25 17:23:10 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 1073741824" returned: 0 in 0.389s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:10 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1
Sep 25 17:23:10 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:10 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc3a037-d118-44b5-b2db-a84b578edb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac7080f-8948-490a-8c78-b6064a8e28c1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfcad1a-b81b-4004-97b3-7ac03d1a06d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Volume volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 (5ac7080f-8948-490a-8c78-b6064a8e28c1): created successfully
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfcad1a-b81b-4004-97b3-7ac03d1a06d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (bf28d39a-8cbc-498c-9ed2-b02cb6553f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e55c30f-257c-40f0-88fa-51a4d306b1e5 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-5c93b255-d529-4c0f-9816-aba8d8b26593-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "cinder-5c93b255-d529-4c0f-9816-aba8d8b26593-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-quobyte-5c93b255-d529-4c0f-9816-aba8d8b26593" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-5c93b255-d529-4c0f-9816-aba8d8b26593" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ab0f7-6168-453b-9db0-599e9c4ac526]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:11 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593
Sep 25 17:23:11 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:11 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593" returned: 0 in 0.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:11 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593
Sep 25 17:23:11 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot cabb4b82-eae4-4d77-81a7-617387e9eb49 of volume 5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc308ac-05c2-42b9-bef7-1c6ea565b1a3]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:11 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5c93b255-d529-4c0f-9816-aba8d8b26593" returned: 0 in 0.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-5c93b255-d529-4c0f-9816-aba8d8b26593" released by "delete_volume" :: held 0.675s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Created reservations ['1c3c3026-c46c-4581-9c74-8ab384c19ddb', '113472bf-7606-4986-9a00-86a748d900f4', '288d85b8-6dee-4d25-9692-5bc47113c2bc', '5e491c90-037b-4abd-911c-5bc39264d061'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:11 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1
Sep 25 17:23:11 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:11 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:11 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:12 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:12 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 1G
Sep 25 17:23:12 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:12 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Deleted volume successfully.
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0c49cada-5fc4-4d0a-a847-696ed9d9256c tempest-ProjectReaderTests-228671652 None] Lock "cinder-5c93b255-d529-4c0f-9816-aba8d8b26593-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:12 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 1G" returned: 0 in 0.456s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:12 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49
Sep 25 17:23:12 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (57e4e956-76bc-428f-a9b9-d4fcf5e7d084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c37e185-d946-40d9-ab00-ace0d18446f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c37e185-d946-40d9-ab00-ace0d18446f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163632919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3aa56e-7f1f-4dad-af8c-98a86c871990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:13Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd241af-e10e-4d26-85f3-cefc3638bb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd241af-e10e-4d26-85f3-cefc3638bb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d782959-32ab-4960-9378-b62231f7477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d782959-32ab-4960-9378-b62231f7477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3aa56e-7f1f-4dad-af8c-98a86c871990', 'volume_name': 'volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c76cd19-51f6-49ec-8f57-feaa739f6a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c76cd19-51f6-49ec-8f57-feaa739f6a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35752dff-8571-45fc-8536-399e4fc85415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Volume 1b3aa56e-7f1f-4dad-af8c-98a86c871990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990', 'volume_size': 1}
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:12 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:12 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 is being set with open permissions: ugo+rw
Sep 25 17:23:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:12 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49
Sep 25 17:23:12 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:13 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49" returned: 0 in 0.231s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:13 devstack sudo[107682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info
Sep 25 17:23:13 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:13 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info" returned: 0 in 0.243s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:13 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info is being set with open permissions: ugo+rw
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:13 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info
Sep 25 17:23:13 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:13 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.info" returned: 0 in 0.232s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-163632919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3aa56e-7f1f-4dad-af8c-98a86c871990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a62ff3bc11456594841d168c8cbc71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:13Z,use_quota=True,user_id='fe94ceec9d234c8681824150f91d077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Creating volume 1b3aa56e-7f1f-4dad-af8c-98a86c871990 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:13 devstack sudo[107688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 1073741824
Sep 25 17:23:13 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-85403c38-f6e1-48a6-b5c8-3c9dc8f44254 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-cabb4b82-eae4-4d77-81a7-617387e9eb49-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-cabb4b82-eae4-4d77-81a7-617387e9eb49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-cabb4b82-eae4-4d77-81a7-617387e9eb49" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-cabb4b82-eae4-4d77-81a7-617387e9eb49" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot cabb4b82-eae4-4d77-81a7-617387e9eb49 of volume 5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4350121-05a1-4859-ab39-0c7cfe89bd06]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:14 devstack sudo[107693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49
Sep 25 17:23:14 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:14 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 1073741824" returned: 0 in 0.487s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:14 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990
Sep 25 17:23:14 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:14 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49" returned: 0 in 0.370s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ac7080f-8948-490a-8c78-b6064a8e28c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c6dc0-43c7-4cd8-81ae-b08a726327c6]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:14 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990" returned: 0 in 0.257s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35752dff-8571-45fc-8536-399e4fc85415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193c72ed-5947-411f-8863-00f00d0c2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Volume volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 (1b3aa56e-7f1f-4dad-af8c-98a86c871990): created successfully
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193c72ed-5947-411f-8863-00f00d0c2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Flow 'volume_create_manager' (57e4e956-76bc-428f-a9b9-d4fcf5e7d084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-796779e6-f51d-454c-a41b-9fa733781160 tempest-ProjectReaderTests-228671652 None] Created volume successfully.
Sep 25 17:23:14 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1
Sep 25 17:23:14 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:14 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1" returned: 0 in 0.381s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-1b3aa56e-7f1f-4dad-af8c-98a86c871990-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:14 devstack sudo[107706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49
Sep 25 17:23:14 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "cinder-1b3aa56e-7f1f-4dad-af8c-98a86c871990-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Acquiring lock "cinder-quobyte-1b3aa56e-7f1f-4dad-af8c-98a86c871990" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-1b3aa56e-7f1f-4dad-af8c-98a86c871990" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c4470-9f74-481d-8aa5-35f8a101adb5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:15 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990
Sep 25 17:23:15 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:15 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49" returned: 0 in 0.361s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:15 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49
Sep 25 17:23:15 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:15 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:15 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990
Sep 25 17:23:15 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:15 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1.cabb4b82-eae4-4d77-81a7-617387e9eb49" returned: 0 in 0.259s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-cabb4b82-eae4-4d77-81a7-617387e9eb49" released by "_delete_snapshot" :: held 1.483s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" released by "delete_snapshot" :: held 1.509s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Created reservations ['23c9b50b-de0a-4909-b828-b2770168bb3d', 'd25959c0-41c3-487e-9233-8d5d001fde26', '68be8a3e-0e8b-4d7e-a1e2-dda1ca246fbd', 'e8d07948-9a2c-4b0f-93a4-3b33df4687fe'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b5270d42-8cb5-4441-b958-913af398d329 tempest-ProjectMemberTests-770038459 None] Lock "cinder-cabb4b82-eae4-4d77-81a7-617387e9eb49-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:15 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-1b3aa56e-7f1f-4dad-af8c-98a86c871990" returned: 0 in 0.265s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "cinder-quobyte-1b3aa56e-7f1f-4dad-af8c-98a86c871990" released by "delete_volume" :: held 0.690s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Created reservations ['e0749ff9-87c0-4c15-9ba7-007d700ab075', 'c6ffcb97-4319-4b05-809b-cc74206fa505', '1979ff30-13da-4d54-aa7a-de85a0ad33b2', 'b1cd08ab-21b7-4803-af6f-8f9c6496b944'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:15 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:15 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:15 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Deleted volume successfully.
Sep 25 17:23:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b51246bc-b20a-4167-b3c3-165a66cc3944 tempest-ProjectReaderTests-228671652 None] Lock "cinder-1b3aa56e-7f1f-4dad-af8c-98a86c871990-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-5ac7080f-8948-490a-8c78-b6064a8e28c1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-5ac7080f-8948-490a-8c78-b6064a8e28c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d553864-962c-4729-8eff-2022d72c2982]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:16 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1
Sep 25 17:23:16 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:16 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1" returned: 0 in 0.395s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:16 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1
Sep 25 17:23:16 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:16 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5ac7080f-8948-490a-8c78-b6064a8e28c1" returned: 0 in 0.252s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-5ac7080f-8948-490a-8c78-b6064a8e28c1" released by "delete_volume" :: held 0.733s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Created reservations ['b1177eaf-ee2b-4300-8480-40dd7bbaa71d', '0bf12626-e00c-4c06-891f-8778b961c416', 'eee9e728-2f12-4490-8999-a1d0e2faa883', '4ced9263-b3ff-4de7-a0b1-194bf0ef08b8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:17 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:17 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:17 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ddcac60-eb34-466a-bcb8-2dff588b3dc4 tempest-ProjectMemberTests-770038459 None] Lock "cinder-5ac7080f-8948-490a-8c78-b6064a8e28c1-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (69b6c5bb-f8df-4160-9442-7bf5bd5d4017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06e4d5f-32f3-4fb2-bf55-7405bd0b6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06e4d5f-32f3-4fb2-bf55-7405bd0b6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006252309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31333d0-8631-4ad8-aa28-7c4b93326fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:18Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f102b0-98dc-4e63-b939-73f38f42efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f102b0-98dc-4e63-b939-73f38f42efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694096cd-d28e-46f3-921e-2b8ca8796184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694096cd-d28e-46f3-921e-2b8ca8796184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31333d0-8631-4ad8-aa28-7c4b93326fc4', 'volume_name': 'volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42087cd8-9b18-4659-879a-ca57f7e4ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42087cd8-9b18-4659-879a-ca57f7e4ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8209a3-94cf-4ca7-8598-30fd9966bf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Volume d31333d0-8631-4ad8-aa28-7c4b93326fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4', 'volume_size': 1}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2006252309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31333d0-8631-4ad8-aa28-7c4b93326fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:18Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Creating volume d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:17 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:17 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 1073741824
Sep 25 17:23:17 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:18 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 1073741824" returned: 0 in 0.464s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:18 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4
Sep 25 17:23:18 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:18 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4" returned: 0 in 0.252s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8209a3-94cf-4ca7-8598-30fd9966bf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32f996-15fd-4d3d-9196-5506d53aad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Volume volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 (d31333d0-8631-4ad8-aa28-7c4b93326fc4): created successfully
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32f996-15fd-4d3d-9196-5506d53aad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (69b6c5bb-f8df-4160-9442-7bf5bd5d4017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-43767b94-2e5b-4921-8459-916568d9d5f3 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Creating offline snapshot ab7bb343-155d-470f-a232-e1ac3b7f2005 of volume d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bde4d9-2ab6-4412-9787-611ae29edc91]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:19 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4
Sep 25 17:23:19 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:19 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4" returned: 0 in 0.368s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:19 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 1G
Sep 25 17:23:19 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:19 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 1G" returned: 0 in 0.462s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:19 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005
Sep 25 17:23:19 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:20 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:20 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 is being set with open permissions: ugo+rw
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:20 devstack sudo[107761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005
Sep 25 17:23:20 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:20 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:20 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info
Sep 25 17:23:20 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:20 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:20 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info is being set with open permissions: ugo+rw
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:20 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info
Sep 25 17:23:20 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:20 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.info" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e7fde16-2463-4d4a-9c29-d10f6d78c72a tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-ab7bb343-155d-470f-a232-e1ac3b7f2005-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-ab7bb343-155d-470f-a232-e1ac3b7f2005-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-ab7bb343-155d-470f-a232-e1ac3b7f2005" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ab7bb343-155d-470f-a232-e1ac3b7f2005" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot ab7bb343-155d-470f-a232-e1ac3b7f2005 of volume d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[da83ca93-1a0c-4f1f-972f-35fcb7198c14]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:21 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005
Sep 25 17:23:21 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:21 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005" returned: 0 in 0.367s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0139ceb-cd48-4957-95e6-3f201c2278c1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:21 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4
Sep 25 17:23:21 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:21 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4" returned: 0 in 0.396s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:21 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005
Sep 25 17:23:21 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:22 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005" returned: 0 in 0.351s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:22 devstack sudo[107786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005
Sep 25 17:23:22 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:22 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4.ab7bb343-155d-470f-a232-e1ac3b7f2005" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ab7bb343-155d-470f-a232-e1ac3b7f2005" released by "_delete_snapshot" :: held 1.469s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" released by "delete_snapshot" :: held 1.494s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Created reservations ['403af677-3550-4f9d-94c2-1c6c0a67a147', '65957178-c494-455d-baa7-913e523eb4dc', '3e6ca7b4-975d-41a3-90ad-b1cc90c58f3e', '94e62dd9-c300-48e7-8e05-1b133a79685f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8729cfad-2656-4d6f-9b86-31080c33af92 tempest-ProjectMemberTests-770038459 None] Lock "cinder-ab7bb343-155d-470f-a232-e1ac3b7f2005-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-d31333d0-8631-4ad8-aa28-7c4b93326fc4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "cinder-d31333d0-8631-4ad8-aa28-7c4b93326fc4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0029f27-78ea-446e-90e8-3225f9f28c42]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:23 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4
Sep 25 17:23:23 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:23 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4" returned: 0 in 0.489s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:23 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4
Sep 25 17:23:23 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:24 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-d31333d0-8631-4ad8-aa28-7c4b93326fc4" returned: 0 in 0.259s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-d31333d0-8631-4ad8-aa28-7c4b93326fc4" released by "delete_volume" :: held 0.843s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Created reservations ['abecbe7b-0402-47c2-b3dd-6f9b9023ae46', '1bca72dc-0623-49cc-aedf-11a2f4180967', 'd73431ed-4b72-42dd-b9a7-86809a1475a0', '8d7c3b68-ab75-4a36-9757-09d7eb63140a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:24 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:24 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:24 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.276s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-237639f5-e516-4c1f-8042-0fc335356326 tempest-ProjectMemberTests-770038459 None] Lock "cinder-d31333d0-8631-4ad8-aa28-7c4b93326fc4-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (83e910ad-c096-4f86-9d8f-13f5205a2f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0f483e-a4f7-4a85-9bdb-f0ef42a83e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0f483e-a4f7-4a85-9bdb-f0ef42a83e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136299253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a71cac-be9e-4be4-988c-a5f71608365f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:25Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e254db-f6b5-43ff-9171-0be1712d8af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e254db-f6b5-43ff-9171-0be1712d8af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6eb6cd-33db-4999-a16b-bcf6697ccdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6eb6cd-33db-4999-a16b-bcf6697ccdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a71cac-be9e-4be4-988c-a5f71608365f', 'volume_name': 'volume-64a71cac-be9e-4be4-988c-a5f71608365f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e131163b-a37f-4e12-ac91-cc44354a62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e131163b-a37f-4e12-ac91-cc44354a62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e285d-54b6-4cb3-8448-1edada871444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Volume 64a71cac-be9e-4be4-988c-a5f71608365f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a71cac-be9e-4be4-988c-a5f71608365f', 'volume_size': 1}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136299253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a71cac-be9e-4be4-988c-a5f71608365f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:25Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Creating volume 64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:25 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f 1073741824
Sep 25 17:23:25 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:25 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f 1073741824" returned: 0 in 0.468s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:25 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f
Sep 25 17:23:25 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:25 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f" returned: 0 in 0.257s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e285d-54b6-4cb3-8448-1edada871444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a71cac-be9e-4be4-988c-a5f71608365f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61a9881-d674-45ae-878e-52cbf772da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Volume volume-64a71cac-be9e-4be4-988c-a5f71608365f (64a71cac-be9e-4be4-988c-a5f71608365f): created successfully
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61a9881-d674-45ae-878e-52cbf772da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (83e910ad-c096-4f86-9d8f-13f5205a2f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9408b828-f415-45a2-b570-b94823e85815 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 of volume 64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc127b9-9f8d-4e67-89fd-3d6b5eaf1399]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:26 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f
Sep 25 17:23:26 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:26 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f" returned: 0 in 0.403s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:26 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 1G
Sep 25 17:23:26 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:27 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 1G" returned: 0 in 0.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a71cac-be9e-4be4-988c-a5f71608365f -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:27 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a71cac-be9e-4be4-988c-a5f71608365f -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6
Sep 25 17:23:27 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:27 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a71cac-be9e-4be4-988c-a5f71608365f -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" returned: 0 in 0.302s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 is being set with open permissions: ugo+rw
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:27 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6
Sep 25 17:23:27 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:27 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:27 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info
Sep 25 17:23:27 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:27 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info" returned: 0 in 0.274s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info is being set with open permissions: ugo+rw
Sep 25 17:23:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:27 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info
Sep 25 17:23:27 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:28 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.info" returned: 0 in 0.276s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-66437552-ef4d-48d5-9f6a-4f98a15c00d0 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 of volume 64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[46410af7-b262-4e53-a52c-154c1b96af57]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:29 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6
Sep 25 17:23:29 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:29 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" returned: 0 in 0.467s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a71cac-be9e-4be4-988c-a5f71608365f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2fd3f-8098-430f-8a5b-d820df655aa5]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:30 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f
Sep 25 17:23:30 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:30 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f" returned: 0 in 0.464s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:30 devstack sudo[107848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6
Sep 25 17:23:30 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:30 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:30 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6
Sep 25 17:23:30 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:31 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f.6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" returned: 0 in 0.329s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6" released by "_delete_snapshot" :: held 1.775s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" released by "delete_snapshot" :: held 1.801s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Created reservations ['c9d799c8-cc05-4cd0-ad00-532ebfb528c0', 'dac6825b-2a0d-462f-af63-9e92bd1001dc', '3492c40b-acfa-463a-805a-b790f3e7e119', 'b6831045-56f7-4cbd-9758-72c7f46917e8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f93c0ae8-3dee-4323-b727-63c89be28d87 tempest-ProjectMemberTests-770038459 None] Lock "cinder-6ade1ab9-a43c-4f7a-8f8e-15a704b053b6-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-64a71cac-be9e-4be4-988c-a5f71608365f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "cinder-64a71cac-be9e-4be4-988c-a5f71608365f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[631569c8-0992-4cd0-b456-837f46897b90]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:31 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f
Sep 25 17:23:31 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:32 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:32 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f
Sep 25 17:23:32 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:32 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-64a71cac-be9e-4be4-988c-a5f71608365f" returned: 0 in 0.258s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-64a71cac-be9e-4be4-988c-a5f71608365f" released by "delete_volume" :: held 0.770s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Created reservations ['4c8d814c-2e01-4e93-bc9e-f16d9d4217e3', '40ecbad2-fa80-4e0a-98f9-97a05a457262', '8644d003-56a9-42e7-ad09-a9990f5d84b1', '8e99c99c-7897-452c-8313-a1caa6374707'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:32 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:32 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:32 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.255s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1b00e589-df51-4431-8286-f1f9a693a492 tempest-ProjectMemberTests-770038459 None] Lock "cinder-64a71cac-be9e-4be4-988c-a5f71608365f-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (0add98aa-9ccc-457e-9aa3-3844cd37e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da94e91-65eb-414a-9d84-a084efef706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da94e91-65eb-414a-9d84-a084efef706c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278140533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed42cfd2-adf8-45a4-b2f6-aede7e194210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:33Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e6490b-08bc-48a0-abe0-0d5de0efd898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e6490b-08bc-48a0-abe0-0d5de0efd898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18488a75-8f7d-4fc3-8f4f-03d05f06429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18488a75-8f7d-4fc3-8f4f-03d05f06429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed42cfd2-adf8-45a4-b2f6-aede7e194210', 'volume_name': 'volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a4fe06-5aa5-407e-8c41-b5fbf74934de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a4fe06-5aa5-407e-8c41-b5fbf74934de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11bfa35-c13e-4c67-8ace-f44e302ece87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Volume ed42cfd2-adf8-45a4-b2f6-aede7e194210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210', 'volume_size': 1}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278140533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed42cfd2-adf8-45a4-b2f6-aede7e194210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:33Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Creating volume ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:33 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:33 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 1073741824
Sep 25 17:23:33 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:33 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 1073741824" returned: 0 in 0.465s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:33 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210
Sep 25 17:23:33 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:34 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210" returned: 0 in 0.267s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11bfa35-c13e-4c67-8ace-f44e302ece87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b200d988-707a-4f58-98a5-61380bfdfc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Volume volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 (ed42cfd2-adf8-45a4-b2f6-aede7e194210): created successfully
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b200d988-707a-4f58-98a5-61380bfdfc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (0add98aa-9ccc-457e-9aa3-3844cd37e128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-24781df2-239e-4254-a207-100b6991468d tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d of volume ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b82b0f-ce2d-4c03-ba67-8fdfe4deb6a1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:35 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210
Sep 25 17:23:35 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:35 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:35 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d 1G
Sep 25 17:23:35 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:36 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d 1G" returned: 0 in 0.519s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:36 devstack sudo[107897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d
Sep 25 17:23:36 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:36 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" returned: 0 in 0.335s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:36 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d is being set with open permissions: ugo+rw
Sep 25 17:23:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:36 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d
Sep 25 17:23:36 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:37 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" returned: 0 in 0.304s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:37 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info
Sep 25 17:23:37 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:37 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:37 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info is being set with open permissions: ugo+rw
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:37 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info
Sep 25 17:23:37 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:37 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.info" returned: 0 in 0.279s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7a7e31c2-96d5-4b7d-854c-08cb256dabd5 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d of volume ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f067a310-3b07-42da-a727-b47ca3625f9c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:38 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d
Sep 25 17:23:38 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:39 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" returned: 0 in 0.443s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[509713cd-b53d-4ffc-8727-5ddc64e2b07a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:39 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210
Sep 25 17:23:39 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:39 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:39 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d
Sep 25 17:23:39 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:40 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:40 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d
Sep 25 17:23:40 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:40 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210.6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" returned: 0 in 0.303s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d" released by "_delete_snapshot" :: held 1.699s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" released by "delete_snapshot" :: held 1.724s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Created reservations ['84072fdf-7ac7-408c-8794-5b549f852316', '462e4d47-6f3e-45ea-948a-e36708292c81', '927c4dc0-516a-4126-8d32-d218b8d0d8cc', 'bc5b63ef-fe0e-495b-ab8b-ccbd14a20f2d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-429a3c6b-4a56-41d9-a425-d4914e72feaf tempest-ProjectMemberTests-770038459 None] Lock "cinder-6b5b0b7c-8b7f-41cd-9ee4-d855a6a1234d-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-ed42cfd2-adf8-45a4-b2f6-aede7e194210-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Flow 'volume_create_manager' (37a40d48-0561-4bbf-b247-fdc7a29f9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97554483-0a0e-43b1-8f83-7e6b5e5e8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "cinder-ed42cfd2-adf8-45a4-b2f6-aede7e194210-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97554483-0a0e-43b1-8f83-7e6b5e5e8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-84395697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6112c495-4a94-43a3-8b59-e9f251163673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243f46634544eb8091b1063c47e825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:41Z,use_quota=True,user_id='e3b723ccd67449c087d6ba156f1098ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bfe5c7-7a02-4b1c-a28c-a3319722337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bfe5c7-7a02-4b1c-a28c-a3319722337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea43afbd-21ee-4fb5-ac46-b4855e93b6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea43afbd-21ee-4fb5-ac46-b4855e93b6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6112c495-4a94-43a3-8b59-e9f251163673', 'volume_name': 'volume-6112c495-4a94-43a3-8b59-e9f251163673', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7cdf61-3f0a-4d82-a741-0c4764765af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7cdf61-3f0a-4d82-a741-0c4764765af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82b0695-b844-4d0b-907e-eb32ba6cd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Volume 6112c495-4a94-43a3-8b59-e9f251163673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6112c495-4a94-43a3-8b59-e9f251163673', 'volume_size': 1}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-84395697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6112c495-4a94-43a3-8b59-e9f251163673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243f46634544eb8091b1063c47e825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:41Z,use_quota=True,user_id='e3b723ccd67449c087d6ba156f1098ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Creating volume 6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:40 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:40 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 1073741824
Sep 25 17:23:40 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b8b46b-135d-47f8-83b3-5f761bf231bd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:41 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210
Sep 25 17:23:41 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:41 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 1073741824" returned: 0 in 0.429s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:41 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:41 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:41 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210" returned: 0 in 0.412s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:41 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210
Sep 25 17:23:41 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:41 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82b0695-b844-4d0b-907e-eb32ba6cd036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6112c495-4a94-43a3-8b59-e9f251163673', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823ec972-b9d0-46ea-b3e4-40a73055763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Volume volume-6112c495-4a94-43a3-8b59-e9f251163673 (6112c495-4a94-43a3-8b59-e9f251163673): created successfully
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823ec972-b9d0-46ea-b3e4-40a73055763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Flow 'volume_create_manager' (37a40d48-0561-4bbf-b247-fdc7a29f9695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:41 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3b20d75f-0e2c-4baa-b27b-99cb9290595d tempest-SnapshotDependencyTests-1511112613 None] Created volume successfully.
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ed42cfd2-adf8-45a4-b2f6-aede7e194210" returned: 0 in 0.278s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ed42cfd2-adf8-45a4-b2f6-aede7e194210" released by "delete_volume" :: held 0.763s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Created reservations ['36e0f3d0-a452-4383-80c1-25b15073f2eb', '43ff546c-7a6a-4bb0-a8fe-6d8f34fcb057', '7f987c4e-5ed0-4481-ac8a-4a4b2390f6f6', 'd94caa17-b0f9-49cb-b54c-aa97e33a432d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:41 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:41 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:42 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.263s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b34a6afa-57c0-4537-a9d4-8affd0618a6e tempest-ProjectMemberTests-770038459 None] Lock "cinder-ed42cfd2-adf8-45a4-b2f6-aede7e194210-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (05dc3b69-3e77-45b8-a682-a1b99cdaf158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0c0fe2-f0dc-4d04-859a-14ac466c4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0c0fe2-f0dc-4d04-859a-14ac466c4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268743785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea72686-2274-48b7-9621-5f912ea0e29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:42Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5018b64-e5be-43e5-9846-8c17d2b7a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5018b64-e5be-43e5-9846-8c17d2b7a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328d11e4-dc35-4c68-a0be-47b1bc516da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328d11e4-dc35-4c68-a0be-47b1bc516da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea72686-2274-48b7-9621-5f912ea0e29d', 'volume_name': 'volume-9ea72686-2274-48b7-9621-5f912ea0e29d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a60a1a1-4820-4cf7-900b-e9f9444b0e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a60a1a1-4820-4cf7-900b-e9f9444b0e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44663cc3-5c42-427e-8b79-806dd1cb6ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Volume 9ea72686-2274-48b7-9621-5f912ea0e29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea72686-2274-48b7-9621-5f912ea0e29d', 'volume_size': 1}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268743785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea72686-2274-48b7-9621-5f912ea0e29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:42Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Creating volume 9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:42 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d 1073741824
Sep 25 17:23:42 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:42 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d 1073741824" returned: 0 in 0.469s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:43 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d
Sep 25 17:23:43 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:43 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d" returned: 0 in 0.317s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.178s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44663cc3-5c42-427e-8b79-806dd1cb6ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea72686-2274-48b7-9621-5f912ea0e29d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328c1d91-f9c6-43f9-a509-ae8c42c5a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Creating offline snapshot e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 of volume 6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Volume volume-9ea72686-2274-48b7-9621-5f912ea0e29d (9ea72686-2274-48b7-9621-5f912ea0e29d): created successfully
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328c1d91-f9c6-43f9-a509-ae8c42c5a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (05dc3b69-3e77-45b8-a682-a1b99cdaf158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[716f7192-46c6-4af5-8708-a14a08693ff0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-36c25972-a18a-46ce-8611-0831b443273a tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:43 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:43 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:43 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:43 devstack sudo[108000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 1G
Sep 25 17:23:43 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:44 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 1G" returned: 0 in 0.435s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6112c495-4a94-43a3-8b59-e9f251163673 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:44 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6112c495-4a94-43a3-8b59-e9f251163673 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:44 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:44 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6112c495-4a94-43a3-8b59-e9f251163673 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.293s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:44 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 is being set with open permissions: ugo+rw
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:44 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:44 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=150,cinder:INSERT=50,cinder:UPDATE=197,cinder:DELETE=19 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:INSERT=50,cinder:UPDATE=195,cinder:SELECT=134,cinder:DELETE=15 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:44 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:44 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info
Sep 25 17:23:44 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:45 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:45 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info is being set with open permissions: ugo+rw
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:45 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info
Sep 25 17:23:45 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:45 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.info" returned: 0 in 0.259s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.704s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 of volume 9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d57c98-3cbf-4008-899a-aa6de930214c]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-efb84eec-dbc9-49fb-b175-0d1880419612 tempest-SnapshotDependencyTests-1511112613 None] Create snapshot completed successfully
Sep 25 17:23:45 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d
Sep 25 17:23:45 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:45 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d" returned: 0 in 0.432s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:45 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 1G
Sep 25 17:23:45 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:46 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 1G" returned: 0 in 0.450s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea72686-2274-48b7-9621-5f912ea0e29d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:46 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea72686-2274-48b7-9621-5f912ea0e29d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652
Sep 25 17:23:46 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:46 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea72686-2274-48b7-9621-5f912ea0e29d -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" returned: 0 in 0.343s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 is being set with open permissions: ugo+rw
Sep 25 17:23:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:46 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652
Sep 25 17:23:46 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:47 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" returned: 0 in 0.323s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Flow 'volume_create_manager' (a5ed488b-cb16-44e2-b7a5-cd8f7d9beaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca52361-9ff7-43fa-bc52-4c0c5b91d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca52361-9ff7-43fa-bc52-4c0c5b91d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5387474b-8e38-475f-892e-09d191f2ef66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d243f46634544eb8091b1063c47e825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3b3ba66-f500-43f5-a786-b1c90dc1b6f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:47Z,use_quota=True,user_id='e3b723ccd67449c087d6ba156f1098ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731d141b-4844-4baa-9d7f-a845ffd23dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731d141b-4844-4baa-9d7f-a845ffd23dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4d0bf1-a3db-422a-a39f-2611d4b899f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4d0bf1-a3db-422a-a39f-2611d4b899f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5387474b-8e38-475f-892e-09d191f2ef66', 'volume_name': 'volume-5387474b-8e38-475f-892e-09d191f2ef66', 'volume_size': 1, 'snapshot_id': 'e3b3ba66-f500-43f5-a786-b1c90dc1b6f6'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2a864d-205d-41d4-9486-e4b4ae6a457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2a864d-205d-41d4-9486-e4b4ae6a457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d71dab-b296-445b-9e61-55230d5603fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Volume 5387474b-8e38-475f-892e-09d191f2ef66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5387474b-8e38-475f-892e-09d191f2ef66', 'volume_size': 1, 'snapshot_id': 'e3b3ba66-f500-43f5-a786-b1c90dc1b6f6'}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:47 devstack sudo[108039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info
Sep 25 17:23:47 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:47 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info" returned: 0 in 0.255s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:47 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info is being set with open permissions: ugo+rw
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:47 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info
Sep 25 17:23:47 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:47 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.info" returned: 0 in 0.242s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.499s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-5387474b-8e38-475f-892e-09d191f2ef66" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-5387474b-8e38-475f-892e-09d191f2ef66" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Creating volume 5387474b-8e38-475f-892e-09d191f2ef66 from snapshot e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c7a105bf-bac2-484d-8d08-17ee77a0f328 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] snapshot: e3b3ba66-f500-43f5-a786-b1c90dc1b6f6, volume: 5387474b-8e38-475f-892e-09d191f2ef66,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5689ece8-b5ae-45db-8a05-78cad8f69913]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:47 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:47 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 of volume 9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2e851-1223-41a0-802e-5691ae9f6c09]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:48 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652
Sep 25 17:23:48 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:48 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.429s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6112c495-4a94-43a3-8b59-e9f251163673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[604cf7ad-796c-43e2-92db-94638075fa57]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:48 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:48 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:48 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" returned: 0 in 0.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ea72686-2274-48b7-9621-5f912ea0e29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f2a2ae-e5a7-4caf-a768-cca4331f3b30]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:48 devstack sudo[108057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d
Sep 25 17:23:48 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:48 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.416s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Path /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:48 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66
Sep 25 17:23:48 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:48 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:48 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652
Sep 25 17:23:48 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:49 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" returned: 0 in 0.490s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:49 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652
Sep 25 17:23:49 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:49 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d.6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" returned: 0 in 0.521s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652" released by "_delete_snapshot" :: held 1.964s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" released by "delete_snapshot" :: held 2.007s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Created reservations ['c4b4f1e8-a0ca-4d82-b89a-cbacf713742e', '38dc5111-36eb-4f4b-afba-e82ed9ddb921', '4cafad2d-c8ae-4d9c-bced-a182e0d2d546', 'e7e1d91b-96e6-4552-9681-6b28fe81bb80'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:23:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e324f749-96f9-4e42-9eea-d9d1ca94d8ef tempest-ProjectMemberTests-770038459 None] Lock "cinder-6a3ad386-71fd-44a4-ae9a-9ec1bdc26652-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-9ea72686-2274-48b7-9621-5f912ea0e29d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "cinder-9ea72686-2274-48b7-9621-5f912ea0e29d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8187855-eacb-4261-b73d-d91e860182c4]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:51 devstack sudo[108088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d
Sep 25 17:23:51 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:51 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d" returned: 0 in 0.556s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:51 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d
Sep 25 17:23:51 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:52 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-9ea72686-2274-48b7-9621-5f912ea0e29d" returned: 0 in 0.322s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-9ea72686-2274-48b7-9621-5f912ea0e29d" released by "delete_volume" :: held 0.981s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Created reservations ['1eb59f3f-ab78-400d-95d8-5db4952089e4', 'c1219e87-abca-4a51-ad62-ad477e1e65a5', '9abbd2b4-3413-4b38-afde-f1c4b5ac8d34', '398e04f9-b67a-4f15-b585-10a379ab55e6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:52 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:52 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:53 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.524s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:23:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d41b3f3c-98d9-4e6c-b029-638047b3a2a7 tempest-ProjectMemberTests-770038459 None] Lock "cinder-9ea72686-2274-48b7-9621-5f912ea0e29d-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (cd76780a-e1a3-4c6c-bc69-123992aae4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eec92c7-a92c-434c-b064-6974a0c83006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eec92c7-a92c-434c-b064-6974a0c83006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760089299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba065e4f-003c-4c51-b926-605e7c9fd2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:54Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df029702-54e0-4a7e-8d7a-9ef51edf24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df029702-54e0-4a7e-8d7a-9ef51edf24a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c3123-06e7-466f-bfc8-ddb3381a5a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565c3123-06e7-466f-bfc8-ddb3381a5a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba065e4f-003c-4c51-b926-605e7c9fd2cc', 'volume_name': 'volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7528ec77-d14c-43c6-ba85-455b2a029775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7528ec77-d14c-43c6-ba85-455b2a029775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1cf252-d83e-456a-92b2-34ac70f8d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Volume ba065e4f-003c-4c51-b926-605e7c9fd2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc', 'volume_size': 1}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:54 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66" returned: 0 in 6.242s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Image conversion details: src /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 17:23:54 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Converted 1024.00 MB image at 164.03 MB/s
Sep 25 17:23:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 is being set with open permissions: ugo+rw
Sep 25 17:23:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:54 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66
Sep 25 17:23:54 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:55 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66" returned: 0 in 0.244s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" released by "_copy_volume_from_snapshot" :: held 7.418s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-5387474b-8e38-475f-892e-09d191f2ef66" released by "_create_volume_from_snapshot" :: held 7.488s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.511s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760089299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba065e4f-003c-4c51-b926-605e7c9fd2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:54Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Creating volume ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:23:55 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:55 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc 1073741824
Sep 25 17:23:55 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d71dab-b296-445b-9e61-55230d5603fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5387474b-8e38-475f-892e-09d191f2ef66', 'volume_size': 1, 'snapshot_id': 'e3b3ba66-f500-43f5-a786-b1c90dc1b6f6'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7eb3563-ba1c-4e12-a4df-635474efa73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Volume volume-5387474b-8e38-475f-892e-09d191f2ef66 (5387474b-8e38-475f-892e-09d191f2ef66): created successfully
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7eb3563-ba1c-4e12-a4df-635474efa73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Flow 'volume_create_manager' (a5ed488b-cb16-44e2-b7a5-cd8f7d9beaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c087ade4-9532-4ff3-8702-a1925de9b1a2 tempest-SnapshotDependencyTests-1511112613 None] Created volume successfully.
Sep 25 17:23:55 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc 1073741824" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:55 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc
Sep 25 17:23:55 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Deleting offline snapshot e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 of volume 6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:55 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] snapshot_file for this snap is: volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1cf252-d83e-456a-92b2-34ac70f8d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d614f9-395f-4dfe-9237-e0f373f7d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71463c7-7f6d-4648-9ea9-8a748e0628cd]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Volume volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc (ba065e4f-003c-4c51-b926-605e7c9fd2cc): created successfully
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d614f9-395f-4dfe-9237-e0f373f7d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:23:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (cd76780a-e1a3-4c6c-bc69-123992aae4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:23:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d50403e9-5aa1-4fb4-a255-125fcd20caa8 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:23:56 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:56 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:56 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6112c495-4a94-43a3-8b59-e9f251163673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2899343f-1719-4981-a06e-c840e568dadc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:56 devstack sudo[108116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:56 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot 75a43319-e2dc-410c-98de-89e0464b5f6e of volume ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[059fedb6-a1ab-4a63-8179-55acea3f527e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:56 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc
Sep 25 17:23:56 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:56 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.551s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:56 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:56 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:56 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc" returned: 0 in 0.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:56 devstack sudo[108128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e 1G
Sep 25 17:23:56 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:57 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.343s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:57 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6
Sep 25 17:23:57 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:57 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e 1G" returned: 0 in 0.394s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:57 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e
Sep 25 17:23:57 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:57 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673.e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6" released by "_delete_snapshot" :: held 1.675s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" released by "delete_snapshot" :: held 1.701s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:57 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e" returned: 0 in 0.292s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:57 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e is being set with open permissions: ugo+rw
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Created reservations ['f32b4a65-ba25-48d9-b4ea-bce61128b5a0', '6445be94-fdbf-4edd-8013-8afa68b32cee', '2d726370-678f-46b9-9eaa-d797e965accb', '61795de0-f9cf-4e12-96f4-abe2c5d8dc9a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:57 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e
Sep 25 17:23:57 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Delete snapshot completed successfully.
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc902664-2f05-4642-a51d-c5080515361d tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-e3b3ba66-f500-43f5-a786-b1c90dc1b6f6-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:57 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:57 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info
Sep 25 17:23:57 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-6112c495-4a94-43a3-8b59-e9f251163673-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-6112c495-4a94-43a3-8b59-e9f251163673-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0b7d2-af12-475a-8f7d-dbaced835496]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:58 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info" returned: 0 in 0.298s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info is being set with open permissions: ugo+rw
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:58 devstack sudo[108154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info
Sep 25 17:23:58 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:58 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:58 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:58 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.info" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1eed02be-832b-42c7-89c2-9fcdfdcd3ad7 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:23:58 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:58 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673
Sep 25 17:23:58 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-75a43319-e2dc-410c-98de-89e0464b5f6e-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-75a43319-e2dc-410c-98de-89e0464b5f6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-75a43319-e2dc-410c-98de-89e0464b5f6e" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-75a43319-e2dc-410c-98de-89e0464b5f6e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot 75a43319-e2dc-410c-98de-89e0464b5f6e of volume ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06faa37-6740-463e-a567-816af4572578]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:58 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-6112c495-4a94-43a3-8b59-e9f251163673" returned: 0 in 0.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-6112c495-4a94-43a3-8b59-e9f251163673" released by "delete_volume" :: held 0.703s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Created reservations ['a2410078-7190-4187-9f44-f7146a8de9e1', '677777ce-9e07-400d-877b-fce74034dc2e', '716b99ca-8563-4dca-8df5-cd3c05d33644', '3cef2b38-3a94-4ab0-84df-d163e57d06bb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:23:58 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e
Sep 25 17:23:58 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:23:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:58 devstack sudo[108166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:23:58 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:59 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:23:59 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-5387474b-8e38-475f-892e-09d191f2ef66-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6dc26-4a1d-40d2-830e-bc8f0590bf7d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.275s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:23:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Deleted volume successfully.
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-5387474b-8e38-475f-892e-09d191f2ef66-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ddfbb15-77de-43a3-a8c2-f38b1c18e997 tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-6112c495-4a94-43a3-8b59-e9f251163673-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e04841-6579-4c75-8ba5-ea1f0720ae2a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:59 devstack sudo[108172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc
Sep 25 17:23:59 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:59 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66
Sep 25 17:23:59 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:59 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc" returned: 0 in 0.375s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:59 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e
Sep 25 17:23:59 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:59 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66" returned: 0 in 0.362s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:59 devstack sudo[108184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66
Sep 25 17:23:59 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:23:59 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e" returned: 0 in 0.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:23:59 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root
Sep 25 17:23:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-5387474b-8e38-475f-892e-09d191f2ef66" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:23:59 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e
Sep 25 17:23:59 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-quobyte-5387474b-8e38-475f-892e-09d191f2ef66" released by "delete_volume" :: held 0.674s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Created reservations ['0afcc856-9597-4791-9265-8e4c7191aaac', '5c31c3d8-a26e-4af2-9809-eca340c2de59', 'cb6b61d6-06f9-4d7e-824b-f5a772729912', '2601aa3e-05d2-43ef-8995-36a5336f9495'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:00 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:00 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:00 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc.75a43319-e2dc-410c-98de-89e0464b5f6e" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-75a43319-e2dc-410c-98de-89e0464b5f6e" released by "_delete_snapshot" :: held 1.530s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" released by "delete_snapshot" :: held 1.553s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Created reservations ['e3c8c577-ec97-4d9d-bec1-329f237995f5', '68e0e3d6-cd0f-44c8-8056-1b3d6a0261ee', 'e87c9141-7187-4c10-949c-08b9ab0c01d8', '052f720a-f88c-4a2b-b83c-cd7a52f67adf'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11cf1580-3469-4400-8f22-828b6baabc58 tempest-ProjectMemberTests-770038459 None] Lock "cinder-75a43319-e2dc-410c-98de-89e0464b5f6e-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:00 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.296s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Deleted volume successfully.
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5810713a-a137-415c-bf33-f1c69e429adb tempest-SnapshotDependencyTests-1511112613 None] Lock "cinder-5387474b-8e38-475f-892e-09d191f2ef66-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-ba065e4f-003c-4c51-b926-605e7c9fd2cc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "cinder-ba065e4f-003c-4c51-b926-605e7c9fd2cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[19799237-4ef8-4ff7-8505-4ce149e70a3e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:01 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc
Sep 25 17:24:01 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:01 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc" returned: 0 in 0.410s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:01 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc
Sep 25 17:24:01 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:01 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ba065e4f-003c-4c51-b926-605e7c9fd2cc" returned: 0 in 0.280s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-ba065e4f-003c-4c51-b926-605e7c9fd2cc" released by "delete_volume" :: held 0.771s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Created reservations ['991b2e0a-8fa2-4e1f-be30-1f3c1c06dbf7', '4e6de7fd-9d7a-4fdb-b13c-d8ee5e75224a', 'ba9bb20f-9df9-4d70-a01d-cc3525f6f4e5', '469b107e-ea01-4a31-b53a-a306b3dc877b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:01 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:01 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:02 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.285s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-63b7fbb4-d962-49a6-85ec-11f4acb7c4d0 tempest-ProjectMemberTests-770038459 None] Lock "cinder-ba065e4f-003c-4c51-b926-605e7c9fd2cc-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (9cedbbe2-28b4-4ef5-9295-d2b59ae90c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72f1be4-bfa2-495d-b21b-e0f7d25f67ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72f1be4-bfa2-495d-b21b-e0f7d25f67ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699988588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02146599-c63d-4fbe-afe7-725fa7e0dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:03Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce788b6a-91c7-4cc6-9289-345db7bfbad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce788b6a-91c7-4cc6-9289-345db7bfbad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff76d4-2b06-4470-b5c4-cd4f12053c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff76d4-2b06-4470-b5c4-cd4f12053c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02146599-c63d-4fbe-afe7-725fa7e0dff6', 'volume_name': 'volume-02146599-c63d-4fbe-afe7-725fa7e0dff6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da6fd8-3110-41f4-8da3-70d515746107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da6fd8-3110-41f4-8da3-70d515746107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9250d64-9b18-4e9a-84d1-63e106007983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Volume 02146599-c63d-4fbe-afe7-725fa7e0dff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02146599-c63d-4fbe-afe7-725fa7e0dff6', 'volume_size': 1}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699988588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02146599-c63d-4fbe-afe7-725fa7e0dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed44b8f98c60423abe390464a0f8b3c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:03Z,use_quota=True,user_id='b329598dd43f4883a9ed356207b8d3d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Creating volume 02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:02 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:02 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 1073741824
Sep 25 17:24:02 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:03 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 1073741824" returned: 0 in 0.511s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:03 devstack sudo[108214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6
Sep 25 17:24:03 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:03 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9250d64-9b18-4e9a-84d1-63e106007983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02146599-c63d-4fbe-afe7-725fa7e0dff6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5aa0ea-66ac-41d9-9021-c4542d21ee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Volume volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 (02146599-c63d-4fbe-afe7-725fa7e0dff6): created successfully
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5aa0ea-66ac-41d9-9021-c4542d21ee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Flow 'volume_create_manager' (9cedbbe2-28b4-4ef5-9295-d2b59ae90c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a05afc77-d7fc-48b0-89f2-9e98264c2022 tempest-ProjectMemberTests-770038459 None] Created volume successfully.
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:03 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:03 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:03 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:24:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 17:24:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Creating offline snapshot db55ca3f-d699-43ea-bdc1-5d51f9d58bcd of volume 02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c7ce89-d973-455a-911a-7b0ad1c0dc65]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:05 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6
Sep 25 17:24:05 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:05 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6" returned: 0 in 0.390s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:05 devstack sudo[108227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd 1G
Sep 25 17:24:05 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:05 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd 1G" returned: 0 in 0.421s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:05 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd
Sep 25 17:24:05 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:06 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" returned: 0 in 0.331s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd is being set with open permissions: ugo+rw
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:06 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd
Sep 25 17:24:06 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:06 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" returned: 0 in 0.242s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:06 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info
Sep 25 17:24:06 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:06 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info" returned: 0 in 0.296s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info is being set with open permissions: ugo+rw
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:06 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info
Sep 25 17:24:06 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:06 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.info" returned: 0 in 0.248s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ee73fcf-875f-42aa-b1a7-5f2327f5e420 tempest-ProjectMemberTests-770038459 None] Create snapshot completed successfully
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Deleting offline snapshot db55ca3f-d699-43ea-bdc1-5d51f9d58bcd of volume 02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] snapshot_file for this snap is: volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb184c8-3eb5-48b4-b15c-5310de30af43]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:08 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd
Sep 25 17:24:08 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:08 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" returned: 0 in 0.423s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02146599-c63d-4fbe-afe7-725fa7e0dff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8b822-6ac3-4346-b850-6991dfad17bc]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:08 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6
Sep 25 17:24:08 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:09 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6" returned: 0 in 0.399s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:09 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd
Sep 25 17:24:09 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:09 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" returned: 0 in 0.431s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:09 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd
Sep 25 17:24:09 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:09 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6.db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" returned: 0 in 0.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd" released by "_delete_snapshot" :: held 1.641s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" released by "delete_snapshot" :: held 1.672s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Created reservations ['939857eb-ac3c-4b91-983d-af0ae6c0f4ab', '9f971cae-efa1-458f-9de3-92d681961d06', 'd657aca2-a72f-4414-b9ea-4db33de9e286', 'd651fed4-b742-4967-8280-f8e5699eccf4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Delete snapshot completed successfully.
Sep 25 17:24:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3a274b1e-ffb1-4ded-a288-ff2e2c6c724f tempest-ProjectMemberTests-770038459 None] Lock "cinder-db55ca3f-d699-43ea-bdc1-5d51f9d58bcd-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-02146599-c63d-4fbe-afe7-725fa7e0dff6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "cinder-02146599-c63d-4fbe-afe7-725fa7e0dff6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Acquiring lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1bff46-41da-40b9-a54c-156d4444ee89]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:10 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6
Sep 25 17:24:10 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:10 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6" returned: 0 in 0.407s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:10 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6
Sep 25 17:24:10 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:11 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-02146599-c63d-4fbe-afe7-725fa7e0dff6" returned: 0 in 0.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "cinder-quobyte-02146599-c63d-4fbe-afe7-725fa7e0dff6" released by "delete_volume" :: held 0.775s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Created reservations ['efeadfec-8932-4543-b3da-9c89257a37bf', '9bc95af8-a4b7-41d3-b46f-a7b7b2c42c78', 'f3501689-3837-4eb1-921a-6d2b4498e21f', '49271cad-f2b4-4dc5-9d03-8df9033e0b19'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:11 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:11 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:11 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.268s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Deleted volume successfully.
Sep 25 17:24:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f8bb3837-5a39-436e-ba12-d61635597432 tempest-ProjectMemberTests-770038459 None] Lock "cinder-02146599-c63d-4fbe-afe7-725fa7e0dff6-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (43c11e3f-ee00-4e88-91aa-ffd4f22b862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29517ae-f612-468b-b1f4-ff2bac00c0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29517ae-f612-468b-b1f4-ff2bac00c0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389147597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f50586-33ba-4a49-a62e-ecdb8e041bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877039f0-44fa-4f6b-a860-2c483f1ce098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877039f0-44fa-4f6b-a860-2c483f1ce098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8200c6-ec2a-408e-8be3-611c200a43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8200c6-ec2a-408e-8be3-611c200a43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f50586-33ba-4a49-a62e-ecdb8e041bf8', 'volume_name': 'volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9adb5a0-6c74-42d6-ae67-0eacd7a13f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9adb5a0-6c74-42d6-ae67-0eacd7a13f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5305e1c-3b5e-43e7-b28b-4252225e6cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Volume 00f50586-33ba-4a49-a62e-ecdb8e041bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8', 'volume_size': 1}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389147597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f50586-33ba-4a49-a62e-ecdb8e041bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:15Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Creating volume 00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:15 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 1073741824
Sep 25 17:24:15 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:15 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 1073741824" returned: 0 in 0.402s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:15 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8
Sep 25 17:24:15 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:16 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8" returned: 0 in 0.243s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5305e1c-3b5e-43e7-b28b-4252225e6cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804b68a4-c755-4b2c-a8c9-bbc0698af3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Volume volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 (00f50586-33ba-4a49-a62e-ecdb8e041bf8): created successfully
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804b68a4-c755-4b2c-a8c9-bbc0698af3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (43c11e3f-ee00-4e88-91aa-ffd4f22b862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e35717b9-385a-4933-89f4-4e8835eb36fd tempest-ProjectReaderTests-1660760386 None] Created volume successfully.
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Creating offline snapshot 060a7d2d-94ff-4275-8f74-c3b408411d7a of volume 00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d859038a-f829-4024-9827-f0d721b354ce]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:16 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8
Sep 25 17:24:16 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:16 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8" returned: 0 in 0.357s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:16 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a 1G
Sep 25 17:24:16 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:17 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a 1G" returned: 0 in 0.382s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:17 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a
Sep 25 17:24:17 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:17 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a" returned: 0 in 0.286s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:17 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a is being set with open permissions: ugo+rw
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:17 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a
Sep 25 17:24:17 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:17 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a" returned: 0 in 0.245s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:17 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info
Sep 25 17:24:17 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:18 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info is being set with open permissions: ugo+rw
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:18 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info
Sep 25 17:24:18 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:18 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.info" returned: 0 in 0.239s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-29111747-0e05-490c-999e-f77a87ddd14a tempest-ProjectReaderTests-1660760386 None] Create snapshot completed successfully
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-060a7d2d-94ff-4275-8f74-c3b408411d7a-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-060a7d2d-94ff-4275-8f74-c3b408411d7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-060a7d2d-94ff-4275-8f74-c3b408411d7a" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-060a7d2d-94ff-4275-8f74-c3b408411d7a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Deleting offline snapshot 060a7d2d-94ff-4275-8f74-c3b408411d7a of volume 00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] snapshot_file for this snap is: volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a2c4f5-8395-4c87-bb7a-92896b6c84f0]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:18 devstack sudo[108316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a
Sep 25 17:24:18 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:19 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a" returned: 0 in 0.355s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c0804f-7491-4240-a0cf-66c886765e8b]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:19 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8
Sep 25 17:24:19 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:19 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8" returned: 0 in 0.354s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:19 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a
Sep 25 17:24:19 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:19 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a" returned: 0 in 0.324s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:19 devstack sudo[108331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a
Sep 25 17:24:19 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:20 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8.060a7d2d-94ff-4275-8f74-c3b408411d7a" returned: 0 in 0.250s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-060a7d2d-94ff-4275-8f74-c3b408411d7a" released by "_delete_snapshot" :: held 1.384s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" released by "delete_snapshot" :: held 1.405s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Created reservations ['6587861e-348c-4156-90cb-a1487331b5a0', '2f7dd882-b597-4746-907d-7b04987e9e9e', '6e2d3a2e-e897-4362-9a73-139779b32a2d', '21bc3dc1-e499-482b-864e-d78ea5020f94'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Delete snapshot completed successfully.
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-77225a03-c47a-4505-a97c-ebd8d1efcf9d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-060a7d2d-94ff-4275-8f74-c3b408411d7a-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-00f50586-33ba-4a49-a62e-ecdb8e041bf8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-00f50586-33ba-4a49-a62e-ecdb8e041bf8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375e1f3-66fb-4ff4-8018-5cfac22d80a1]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:21 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8
Sep 25 17:24:21 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:21 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8" returned: 0 in 0.351s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:21 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8
Sep 25 17:24:21 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:21 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00f50586-33ba-4a49-a62e-ecdb8e041bf8" returned: 0 in 0.233s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00f50586-33ba-4a49-a62e-ecdb8e041bf8" released by "delete_volume" :: held 0.642s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Created reservations ['0a6ace50-bfde-4740-9726-962ba2607507', 'c6533feb-51bd-4b9c-909c-d5aaba6d4463', 'a8e55835-277d-4d34-a544-4296bf06c130', '0b8bb83c-c928-4603-ab87-668600b7db4f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:21 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:21 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:21 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.263s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Deleted volume successfully.
Sep 25 17:24:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc66984c-c7b4-4b6f-a57f-a69c2547be09 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-00f50586-33ba-4a49-a62e-ecdb8e041bf8-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (a447388a-b53c-42f2-b55e-f16418939114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d6f8d-48a7-481d-8197-e423056dd4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925d6f8d-48a7-481d-8197-e423056dd4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137962722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff558b7f-2590-409a-b253-f2c658856575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:22Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c26c7-74c0-44b5-8298-7cb442e3b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c26c7-74c0-44b5-8298-7cb442e3b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1198980-b983-4dff-a24d-a8e632df1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1198980-b983-4dff-a24d-a8e632df1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff558b7f-2590-409a-b253-f2c658856575', 'volume_name': 'volume-ff558b7f-2590-409a-b253-f2c658856575', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1066302e-12b2-4115-8ac9-e652d1593713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1066302e-12b2-4115-8ac9-e652d1593713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8ef096-d728-421d-989a-c27484453faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Volume ff558b7f-2590-409a-b253-f2c658856575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff558b7f-2590-409a-b253-f2c658856575', 'volume_size': 1}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137962722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff558b7f-2590-409a-b253-f2c658856575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:22Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Creating volume ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:22 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:22 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 1073741824
Sep 25 17:24:22 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:22 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 1073741824" returned: 0 in 0.414s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:22 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575
Sep 25 17:24:22 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:23 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575" returned: 0 in 0.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8ef096-d728-421d-989a-c27484453faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff558b7f-2590-409a-b253-f2c658856575', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3b5ff5-cc85-44f9-be53-1523cbe93ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Volume volume-ff558b7f-2590-409a-b253-f2c658856575 (ff558b7f-2590-409a-b253-f2c658856575): created successfully
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3b5ff5-cc85-44f9-be53-1523cbe93ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (a447388a-b53c-42f2-b55e-f16418939114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f1b01abc-a20c-486e-95aa-95d495e2d367 tempest-ProjectReaderTests-1660760386 None] Created volume successfully.
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Creating offline snapshot 94d4590e-6603-4231-9fb6-907eea816390 of volume ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe0f2e-d612-491b-8e72-bb97a1f9f486]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:23 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575
Sep 25 17:24:23 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:24 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:24 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 1G
Sep 25 17:24:24 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:24 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 1G" returned: 0 in 0.424s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff558b7f-2590-409a-b253-f2c658856575 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:24 devstack sudo[108364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff558b7f-2590-409a-b253-f2c658856575 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390
Sep 25 17:24:24 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:24 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff558b7f-2590-409a-b253-f2c658856575 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390" returned: 0 in 0.309s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:24 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 is being set with open permissions: ugo+rw
Sep 25 17:24:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:24 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390
Sep 25 17:24:24 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:25 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390" returned: 0 in 0.253s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:25 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info
Sep 25 17:24:25 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:25 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:25 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info is being set with open permissions: ugo+rw
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:25 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info
Sep 25 17:24:25 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:25 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.info" returned: 0 in 0.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6d9c8c53-e813-4c0b-b69a-d365157422c2 tempest-ProjectReaderTests-1660760386 None] Create snapshot completed successfully
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-94d4590e-6603-4231-9fb6-907eea816390-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-94d4590e-6603-4231-9fb6-907eea816390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-94d4590e-6603-4231-9fb6-907eea816390" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-94d4590e-6603-4231-9fb6-907eea816390" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Deleting offline snapshot 94d4590e-6603-4231-9fb6-907eea816390 of volume ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] snapshot_file for this snap is: volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c90e7fe-38b0-4e60-9de8-c80337e85c4e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:26 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390
Sep 25 17:24:26 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:26 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390" returned: 0 in 0.383s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff558b7f-2590-409a-b253-f2c658856575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b32c6-73bc-42bf-8b32-5d23ebe4c4d8]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:26 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575
Sep 25 17:24:26 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:26 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575" returned: 0 in 0.365s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:26 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390
Sep 25 17:24:26 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:27 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390" returned: 0 in 0.340s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:27 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390
Sep 25 17:24:27 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:27 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575.94d4590e-6603-4231-9fb6-907eea816390" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-94d4590e-6603-4231-9fb6-907eea816390" released by "_delete_snapshot" :: held 1.456s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" released by "delete_snapshot" :: held 1.480s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Created reservations ['0153e086-22fc-4fa2-96bf-01c32d68109c', '0d710bb4-50cd-438e-9973-bbecca143ef5', 'c2318a09-e648-49b9-b574-31c117d5621c', 'c6040fc3-b4e2-4a09-9f73-e4f34a08f104'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Delete snapshot completed successfully.
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e6bd5a0-76f8-4bf4-a8ae-929948bc79e1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-94d4590e-6603-4231-9fb6-907eea816390-delete_snapshot" released by "delete_snapshot" :: held 1.626s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-ff558b7f-2590-409a-b253-f2c658856575-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-ff558b7f-2590-409a-b253-f2c658856575-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db306c-cc8b-4818-a79d-97c120fe7846]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:28 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575
Sep 25 17:24:28 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:28 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575" returned: 0 in 0.377s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:28 devstack sudo[108402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575
Sep 25 17:24:28 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:28 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-ff558b7f-2590-409a-b253-f2c658856575" returned: 0 in 0.274s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-ff558b7f-2590-409a-b253-f2c658856575" released by "delete_volume" :: held 0.716s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Created reservations ['df9d25ed-c37e-430e-9a75-90c90bed293c', '935539d7-d89d-48ff-9568-a9a31846ca0e', 'e938fa3f-37f4-434d-879f-47f1baba03a6', 'd653f798-9e18-47d5-b181-4af0fa79b4d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:28 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:28 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:29 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Deleted volume successfully.
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-db5c282e-8875-44fb-9c82-f3a0fa158ff0 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-ff558b7f-2590-409a-b253-f2c658856575-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (f0384687-d90c-42f8-885b-2bf405a942f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb37af4e-cb31-4fb7-bd92-d0aa36657e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb37af4e-cb31-4fb7-bd92-d0aa36657e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145059559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f1b91-2fe7-40d2-b459-57377916d359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:30Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc2596b-3c02-4c83-921b-371277bb85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc2596b-3c02-4c83-921b-371277bb85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63f8ba0-66a9-485f-81d8-3a77ee5a5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63f8ba0-66a9-485f-81d8-3a77ee5a5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9f1b91-2fe7-40d2-b459-57377916d359', 'volume_name': 'volume-eb9f1b91-2fe7-40d2-b459-57377916d359', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc380099-7d94-4e4b-99f6-ffb1b9d52ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc380099-7d94-4e4b-99f6-ffb1b9d52ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a647a6ed-380c-4229-b0a4-6516cec015c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Volume eb9f1b91-2fe7-40d2-b459-57377916d359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9f1b91-2fe7-40d2-b459-57377916d359', 'volume_size': 1}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145059559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9f1b91-2fe7-40d2-b459-57377916d359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:30Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Creating volume eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:29 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:29 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 1073741824
Sep 25 17:24:29 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:30 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 1073741824" returned: 0 in 0.420s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:30 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359
Sep 25 17:24:30 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:30 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359" returned: 0 in 0.270s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a647a6ed-380c-4229-b0a4-6516cec015c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9f1b91-2fe7-40d2-b459-57377916d359', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f36f4-1d43-4a3a-9c68-8597ab4e2869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Volume volume-eb9f1b91-2fe7-40d2-b459-57377916d359 (eb9f1b91-2fe7-40d2-b459-57377916d359): created successfully
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f36f4-1d43-4a3a-9c68-8597ab4e2869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (f0384687-d90c-42f8-885b-2bf405a942f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a75c3c94-f0d5-44bb-84e5-b617577da12d tempest-ProjectReaderTests-1660760386 None] Created volume successfully.
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Creating offline snapshot 507fe74d-4897-471f-8358-c705ff4a0291 of volume eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007ad17-e9a8-4257-89f3-45852aafda11]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:30 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359
Sep 25 17:24:30 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:31 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359" returned: 0 in 0.387s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:31 devstack sudo[108424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 1G
Sep 25 17:24:31 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:31 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 1G" returned: 0 in 0.401s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f1b91-2fe7-40d2-b459-57377916d359 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:31 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f1b91-2fe7-40d2-b459-57377916d359 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291
Sep 25 17:24:31 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:31 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb9f1b91-2fe7-40d2-b459-57377916d359 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291" returned: 0 in 0.310s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 is being set with open permissions: ugo+rw
Sep 25 17:24:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:31 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291
Sep 25 17:24:31 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:32 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291" returned: 0 in 0.239s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:32 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info
Sep 25 17:24:32 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:32 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:32 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info is being set with open permissions: ugo+rw
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:32 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info
Sep 25 17:24:32 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:32 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.info" returned: 0 in 0.236s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2defd162-c0f6-4f37-a7e4-852e8215145b tempest-ProjectReaderTests-1660760386 None] Create snapshot completed successfully
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-507fe74d-4897-471f-8358-c705ff4a0291-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-507fe74d-4897-471f-8358-c705ff4a0291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-507fe74d-4897-471f-8358-c705ff4a0291" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-507fe74d-4897-471f-8358-c705ff4a0291" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Deleting offline snapshot 507fe74d-4897-471f-8358-c705ff4a0291 of volume eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] snapshot_file for this snap is: volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e8027c-7684-4a1c-b4e6-a2a57640ed35]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:33 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291
Sep 25 17:24:33 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:33 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291" returned: 0 in 0.358s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb9f1b91-2fe7-40d2-b459-57377916d359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca3806-3193-45dc-b57a-c63e497a9933]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:33 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359
Sep 25 17:24:33 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:33 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359" returned: 0 in 0.376s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:33 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291
Sep 25 17:24:33 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:34 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291" returned: 0 in 0.345s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:34 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291
Sep 25 17:24:34 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:34 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359.507fe74d-4897-471f-8358-c705ff4a0291" returned: 0 in 0.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-507fe74d-4897-471f-8358-c705ff4a0291" released by "_delete_snapshot" :: held 1.459s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" released by "delete_snapshot" :: held 1.481s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Created reservations ['52860dc0-1fcf-4dbc-b4f9-78d786b328d7', 'cee84ceb-df94-40c5-abda-3d0682d03187', 'b1403eda-4be3-4d6c-9cc4-56c12199d55d', 'a71e61aa-3477-4ad5-be94-689024a81fd5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Delete snapshot completed successfully.
Sep 25 17:24:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3e857b1e-cfc7-4074-a9da-64e3d4d68917 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-507fe74d-4897-471f-8358-c705ff4a0291-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-eb9f1b91-2fe7-40d2-b459-57377916d359-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-eb9f1b91-2fe7-40d2-b459-57377916d359-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c4012-46ee-4109-a637-d9a2a4bb558d]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:35 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359
Sep 25 17:24:35 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:35 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359" returned: 0 in 0.393s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:35 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359
Sep 25 17:24:35 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:35 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-eb9f1b91-2fe7-40d2-b459-57377916d359" returned: 0 in 0.261s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-eb9f1b91-2fe7-40d2-b459-57377916d359" released by "delete_volume" :: held 0.719s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Created reservations ['9f56d41b-aa7d-4230-a691-b151f2ab5aae', '66b512d0-7598-499b-8c8c-d9c24e77cc3d', '5644d0fc-5c82-4eac-b4ed-c37581c7c7a4', '2cbb3df2-0341-4a7c-b475-b88a67a78226'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:36 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:36 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:36 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Deleted volume successfully.
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fba773cf-b569-40a7-b4c3-c71895dc582d tempest-ProjectReaderTests-1660760386 None] Lock "cinder-eb9f1b91-2fe7-40d2-b459-57377916d359-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (ae973223-4693-482d-9381-dba1a50b3cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eaceb6-7658-496b-93c0-82bade943050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91eaceb6-7658-496b-93c0-82bade943050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182444628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00987952-7814-423a-9f81-076d2e9bf559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:37Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2da9a92-8d7c-46da-8382-0010c071357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2da9a92-8d7c-46da-8382-0010c071357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a9247d-b6b3-4ea3-a26d-6a59b09b2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a9247d-b6b3-4ea3-a26d-6a59b09b2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00987952-7814-423a-9f81-076d2e9bf559', 'volume_name': 'volume-00987952-7814-423a-9f81-076d2e9bf559', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c83762-fdb7-4faf-ab97-0b8ece3a6833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c83762-fdb7-4faf-ab97-0b8ece3a6833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a638036-216d-4c20-a042-c946cc66a633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Volume 00987952-7814-423a-9f81-076d2e9bf559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00987952-7814-423a-9f81-076d2e9bf559', 'volume_size': 1}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182444628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00987952-7814-423a-9f81-076d2e9bf559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:37Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Creating volume 00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:36 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:36 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 1073741824
Sep 25 17:24:36 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:37 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 1073741824" returned: 0 in 0.424s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:37 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559
Sep 25 17:24:37 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:37 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a638036-216d-4c20-a042-c946cc66a633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00987952-7814-423a-9f81-076d2e9bf559', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1473b-e3f7-4cfb-be3b-8b81eb38377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Volume volume-00987952-7814-423a-9f81-076d2e9bf559 (00987952-7814-423a-9f81-076d2e9bf559): created successfully
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1473b-e3f7-4cfb-be3b-8b81eb38377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (ae973223-4693-482d-9381-dba1a50b3cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-38132749-2f38-496d-8347-e82a2214740e tempest-ProjectReaderTests-1660760386 None] Created volume successfully.
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Creating offline snapshot b5080ba1-2918-464e-8204-b2b2b554adfa of volume 00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[634fa5af-b13c-4905-8b89-cbc735a3094e]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:38 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559
Sep 25 17:24:38 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:38 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559" returned: 0 in 0.371s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:38 devstack sudo[108493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa 1G
Sep 25 17:24:38 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:38 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa 1G" returned: 0 in 0.418s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00987952-7814-423a-9f81-076d2e9bf559 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:38 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00987952-7814-423a-9f81-076d2e9bf559 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa
Sep 25 17:24:38 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:39 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00987952-7814-423a-9f81-076d2e9bf559 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa is being set with open permissions: ugo+rw
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:39 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa
Sep 25 17:24:39 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:39 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa" returned: 0 in 0.258s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:39 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info
Sep 25 17:24:39 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:39 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info" returned: 0 in 0.264s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info is being set with open permissions: ugo+rw
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:39 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info
Sep 25 17:24:39 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:39 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.info" returned: 0 in 0.249s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-89e23fc1-88df-4763-8f4d-59d591311600 tempest-ProjectReaderTests-1660760386 None] Create snapshot completed successfully
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-b5080ba1-2918-464e-8204-b2b2b554adfa-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-b5080ba1-2918-464e-8204-b2b2b554adfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-b5080ba1-2918-464e-8204-b2b2b554adfa" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-b5080ba1-2918-464e-8204-b2b2b554adfa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Deleting offline snapshot b5080ba1-2918-464e-8204-b2b2b554adfa of volume 00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] snapshot_file for this snap is: volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff1d14d-6a71-42ee-855b-b99afc4c6b99]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:40 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa
Sep 25 17:24:40 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:40 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa" returned: 0 in 0.385s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00987952-7814-423a-9f81-076d2e9bf559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e1a5e6-65e8-48b7-9b3c-31733c6302a3]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:40 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559
Sep 25 17:24:40 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:40 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559" returned: 0 in 0.368s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:40 devstack sudo[108559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa
Sep 25 17:24:40 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:41 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa" returned: 0 in 0.339s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:41 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa
Sep 25 17:24:41 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:41 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559.b5080ba1-2918-464e-8204-b2b2b554adfa" returned: 0 in 0.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-b5080ba1-2918-464e-8204-b2b2b554adfa" released by "_delete_snapshot" :: held 1.464s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" released by "delete_snapshot" :: held 1.484s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Created reservations ['c21faba3-92ed-4f40-9faa-f2c591e9a435', '997e66bd-47a4-4f85-b445-d49e67233648', '215f59b6-90f4-402b-8be3-cb4f3ebb79e0', '7b243a3a-d7a9-4c46-bc9b-74e2fc418c20'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Delete snapshot completed successfully.
Sep 25 17:24:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0f58e403-197e-4533-b088-5328fb0cdf5e tempest-ProjectReaderTests-1660760386 None] Lock "cinder-b5080ba1-2918-464e-8204-b2b2b554adfa-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-00987952-7814-423a-9f81-076d2e9bf559-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-00987952-7814-423a-9f81-076d2e9bf559-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd7742-aba5-4354-bde6-ef0e2c5e5ae7]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:42 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559
Sep 25 17:24:42 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:42 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559" returned: 0 in 0.372s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:42 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559
Sep 25 17:24:42 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:42 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-00987952-7814-423a-9f81-076d2e9bf559" returned: 0 in 0.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-00987952-7814-423a-9f81-076d2e9bf559" released by "delete_volume" :: held 0.700s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Created reservations ['d598e340-5b95-4cff-87ad-4899e595f3e4', '52e8c156-bee1-4194-b3fc-96e2432458b2', '5fcffb7c-6352-4b51-b4bb-204a70d38526', 'ef649286-4db9-458c-88a0-5022aeed3a9c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:43 devstack sudo[108577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:43 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:43 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.254s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Deleted volume successfully.
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-188d935a-cdf4-4039-af02-fb11e97e9cf3 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-00987952-7814-423a-9f81-076d2e9bf559-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (35a009f2-086d-4b66-a39d-5b4d1b99c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75aa175-fa32-4ac9-990a-4d4bcea70ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75aa175-fa32-4ac9-990a-4d4bcea70ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75000988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f42aab8-ef9f-4010-909d-ba9c91cf9b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:44Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a73500-af5f-4889-832c-d8eef4112fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a73500-af5f-4889-832c-d8eef4112fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec2e004-d621-4abb-a358-9ac4891ca6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec2e004-d621-4abb-a358-9ac4891ca6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f42aab8-ef9f-4010-909d-ba9c91cf9b36', 'volume_name': 'volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80012d6-1d4a-4710-b955-bc79443975a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80012d6-1d4a-4710-b955-bc79443975a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f04b624-692e-4cc4-b991-a22bdc6c326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Volume 7f42aab8-ef9f-4010-909d-ba9c91cf9b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36', 'volume_size': 1}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x79a48b4797f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T15:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-75000988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f42aab8-ef9f-4010-909d-ba9c91cf9b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae280c2459a48faad95ce7ca8f0a222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:44Z,use_quota=True,user_id='b7f9c1256aea4be0aea8958b4eaf1fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dcbb163-cfe4-4d12-8b06-1179dd61e567),volume_type_id=4dcbb163-cfe4-4d12-8b06-1179dd61e567)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Creating volume 7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Selected osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 17:24:43 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] casted to osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0
Sep 25 17:24:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:43 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 1073741824
Sep 25 17:24:43 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:44 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 1073741824" returned: 0 in 0.426s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:44 devstack sudo[108587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36
Sep 25 17:24:44 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:44 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" returned: 0 in 0.254s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f04b624-692e-4cc4-b991-a22bdc6c326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa041c8-f398-42de-9b91-54ec67b6a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 17:24:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Volume volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 (7f42aab8-ef9f-4010-909d-ba9c91cf9b36): created successfully
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa041c8-f398-42de-9b91-54ec67b6a531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 17:24:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Flow 'volume_create_manager' (35a009f2-086d-4b66-a39d-5b4d1b99c5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 17:24:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0691eb32-2693-4e73-b020-3cac54980419 tempest-ProjectReaderTests-1660760386 None] Created volume successfully.
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=126,cinder:UPDATE=147,cinder:INSERT=43,cinder:DELETE=11 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=114,cinder:UPDATE=157,cinder:DELETE=14,cinder:INSERT=41 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Creating offline snapshot 86a97e00-72a2-4a72-a82a-25df6e588c44 of volume 7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[044c104d-cc71-4940-8630-1a3b8dd71747]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:45 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36
Sep 25 17:24:45 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:45 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" returned: 0 in 0.369s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:45 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 1G
Sep 25 17:24:45 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:46 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 1G" returned: 0 in 0.486s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:46 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44
Sep 25 17:24:46 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:46 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 -F qcow2 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44" returned: 0 in 0.325s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 is being set with open permissions: ugo+rw
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:46 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44
Sep 25 17:24:46 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:46 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44" returned: 0 in 0.273s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:46 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info
Sep 25 17:24:46 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:46 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info is being set with open permissions: ugo+rw
Sep 25 17:24:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:46 devstack sudo[108612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info
Sep 25 17:24:46 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:47 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.info" returned: 0 in 0.294s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2990bf87-6420-4a0a-b40a-8b27b4c42af8 tempest-ProjectReaderTests-1660760386 None] Create snapshot completed successfully
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-86a97e00-72a2-4a72-a82a-25df6e588c44-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-86a97e00-72a2-4a72-a82a-25df6e588c44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-86a97e00-72a2-4a72-a82a-25df6e588c44" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-86a97e00-72a2-4a72-a82a-25df6e588c44" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Deleting offline snapshot 86a97e00-72a2-4a72-a82a-25df6e588c44 of volume 7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] snapshot_file for this snap is: volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3e966-844a-41a2-8644-a0dd3c41b999]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:48 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44
Sep 25 17:24:48 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:48 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44" returned: 0 in 0.414s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d8d0d-26a5-4d4d-a5af-5ed9aa24bd2a]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:48 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36
Sep 25 17:24:48 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:49 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" returned: 0 in 0.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:49 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44
Sep 25 17:24:49 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:49 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44" returned: 0 in 0.357s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:49 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44
Sep 25 17:24:49 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:49 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36.86a97e00-72a2-4a72-a82a-25df6e588c44" returned: 0 in 0.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-86a97e00-72a2-4a72-a82a-25df6e588c44" released by "_delete_snapshot" :: held 1.564s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" released by "delete_snapshot" :: held 1.587s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Created reservations ['c5bbbc26-bcbe-469c-a485-865e5029ca86', '3d99cde4-9c84-47c4-a333-f4f9a9503107', '78e35147-203e-4855-baa2-f94130bd4c21', '869a30cb-b3e4-4909-b2f9-e562661415d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Delete snapshot completed successfully.
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-92ae2b7b-1c39-444c-99ac-f1d696a187b1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-86a97e00-72a2-4a72-a82a-25df6e588c44-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-7f42aab8-ef9f-4010-909d-ba9c91cf9b36-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-7f42aab8-ef9f-4010-909d-ba9c91cf9b36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f451a-2bfd-46ec-b646-c81fa6d343bf]: (4, 'qcow2') {{(pid=87860) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 17:24:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:50 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36
Sep 25 17:24:50 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:51 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" returned: 0 in 0.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:51 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36
Sep 25 17:24:51 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:51 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c/volume-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" returned: 0 in 0.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-quobyte-7f42aab8-ef9f-4010-909d-ba9c91cf9b36" released by "delete_volume" :: held 0.734s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Created reservations ['4821f470-87d0-4592-9ee4-5275982608b9', '2bd376d7-832e-458d-b916-ea09e1964400', 'a4a51b8c-b29d-4608-a298-d1cbc9abfde6', 'a99caa78-d9b6-4dad-a3f2-562767601bd6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:24:51 devstack sudo[108643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:24:51 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:24:51 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.276s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:24:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Deleted volume successfully.
Sep 25 17:24:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3276db69-dc04-4c80-8333-5f99973551f1 tempest-ProjectReaderTests-1660760386 None] Lock "cinder-7f42aab8-ef9f-4010-909d-ba9c91cf9b36-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 17:25:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:25:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88a2ffe0-42e6-40e0-a407-234a465a82e0'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 17:25:03 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c
Sep 25 17:25:03 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 17:25:03 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/37ea7864631a80fa498e708a978aac7c" returned: 0 in 0.281s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 17:25:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-04fef491-2eae-4c51-a5d8-95b5b9a9d2b6 None None] thread info: [<_MainThread(MainThread, started 133747732140160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133747618194432)>, <Thread(Thread-3 (stat_writer), started daemon 133747620733312)>, <Thread(Rabbit-heartbeat, started daemon 133747617983808)>, <Thread(Thread-5 (_runner), started daemon 133747618068288)>, <Thread(Thread-7 (_runner), started daemon 133747618151744)>, <Thread(fd_logger, started daemon 133747612761344)>, <Thread(privsep_reader, started daemon 133747612699264)>, <Thread(tpool_thread_0, started daemon 133747607262912)>, <Thread(tpool_thread_1, started daemon 133747598870208)>, <Thread(tpool_thread_2, started daemon 133747590477504)>, <Thread(tpool_thread_3, started daemon 133747582084800)>, <Thread(tpool_thread_4, started daemon 133747573692096)>, <Thread(tpool_thread_5, started daemon 133747565299392)>, <Thread(tpool_thread_6, started daemon 133747556906688)>, <Thread(tpool_thread_7, started daemon 133747548513984)>, <Thread(tpool_thread_8, started daemon 133747540121280)>, <Thread(tpool_thread_9, started daemon 133747531712192)>, <Thread(tpool_thread_10, started daemon 133747523303104)>, <Thread(tpool_thread_11, started daemon 133747514894016)>, <Thread(tpool_thread_12, started daemon 133747506484928)>, <Thread(tpool_thread_13, started daemon 133747498075840)>, <Thread(tpool_thread_14, started daemon 133747489666752)>, <Thread(tpool_thread_15, started daemon 133747481257664)>, <Thread(tpool_thread_16, started daemon 133747472848576)>, <Thread(tpool_thread_17, started daemon 133747464439488)>, <Thread(tpool_thread_18, started daemon 133747456030400)>, <Thread(tpool_thread_19, started daemon 133747447621312)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}